2023-03-11 00:53:30,046 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-11 00:53:30,315 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478 2023-03-11 00:53:30,328 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-11 00:53:30,329 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/cluster_222610a7-004e-a65d-0f45-8973b54f643a, deleteOnExit=true 2023-03-11 00:53:30,329 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-11 00:53:30,330 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/test.cache.data in system properties and HBase conf 2023-03-11 00:53:30,331 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/hadoop.tmp.dir in system properties and HBase conf 2023-03-11 00:53:30,331 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/hadoop.log.dir in system properties and HBase conf 2023-03-11 00:53:30,332 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-11 00:53:30,332 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-11 00:53:30,333 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-11 00:53:30,451 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-11 00:53:30,869 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-11 00:53:30,874 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-11 00:53:30,874 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-11 00:53:30,874 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-11 00:53:30,875 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-11 00:53:30,875 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-11 00:53:30,875 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-11 00:53:30,876 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-11 00:53:30,876 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-11 00:53:30,877 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-11 00:53:30,877 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/nfs.dump.dir in system properties and HBase conf 2023-03-11 00:53:30,877 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/java.io.tmpdir in system properties and HBase conf 2023-03-11 00:53:30,877 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-11 00:53:30,878 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-11 00:53:30,878 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-11 00:53:31,476 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-11 00:53:31,480 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-11 00:53:31,767 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-11 00:53:31,947 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-11 00:53:31,966 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-11 00:53:32,005 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-11 00:53:32,042 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/java.io.tmpdir/Jetty_localhost_33829_hdfs____.v9zvhz/webapp 2023-03-11 00:53:32,178 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33829 2023-03-11 00:53:32,193 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-11 00:53:32,194 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-11 00:53:32,778 WARN [Listener at localhost/41469] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-11 00:53:32,869 WARN [Listener at localhost/41469] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-11 00:53:32,892 WARN [Listener at localhost/41469] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-11 00:53:32,900 INFO [Listener at localhost/41469] log.Slf4jLog(67): jetty-6.1.26 2023-03-11 00:53:32,906 INFO [Listener at localhost/41469] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/java.io.tmpdir/Jetty_localhost_33751_datanode____m9jnyy/webapp 2023-03-11 00:53:33,009 INFO [Listener at localhost/41469] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33751 2023-03-11 00:53:33,408 WARN [Listener at localhost/45619] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-11 00:53:33,965 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8bea1faba70daaf5: Processing first storage report for DS-e5ad0c0b-e69d-4451-8af5-d85aaf66d809 from datanode 79787fa5-aa69-41d2-ac7e-af271957f260 2023-03-11 00:53:33,967 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8bea1faba70daaf5: from storage DS-e5ad0c0b-e69d-4451-8af5-d85aaf66d809 node DatanodeRegistration(127.0.0.1:37371, datanodeUuid=79787fa5-aa69-41d2-ac7e-af271957f260, infoPort=42181, infoSecurePort=0, ipcPort=45619, storageInfo=lv=-57;cid=testClusterID;nsid=656969912;c=1678496011552), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-03-11 00:53:33,967 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8bea1faba70daaf5: Processing first storage report for DS-22dd170c-4061-4eb0-9dd3-bdde3c2ae0f3 from datanode 79787fa5-aa69-41d2-ac7e-af271957f260 2023-03-11 00:53:33,967 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8bea1faba70daaf5: from storage DS-22dd170c-4061-4eb0-9dd3-bdde3c2ae0f3 node DatanodeRegistration(127.0.0.1:37371, datanodeUuid=79787fa5-aa69-41d2-ac7e-af271957f260, infoPort=42181, infoSecurePort=0, ipcPort=45619, storageInfo=lv=-57;cid=testClusterID;nsid=656969912;c=1678496011552), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-03-11 00:53:33,999 DEBUG [Listener at localhost/45619] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478 2023-03-11 00:53:34,064 INFO [Listener at localhost/45619] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/cluster_222610a7-004e-a65d-0f45-8973b54f643a/zookeeper_0, clientPort=62412, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/cluster_222610a7-004e-a65d-0f45-8973b54f643a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/cluster_222610a7-004e-a65d-0f45-8973b54f643a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-11 00:53:34,078 INFO [Listener at localhost/45619] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62412 2023-03-11 00:53:34,085 INFO [Listener at localhost/45619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 00:53:34,088 INFO [Listener at localhost/45619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 00:53:34,757 INFO [Listener at localhost/45619] util.FSUtils(471): Created version file at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6 with version=8 2023-03-11 00:53:34,757 INFO [Listener at localhost/45619] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/hbase-staging 2023-03-11 00:53:35,081 INFO [Listener at localhost/45619] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-11 00:53:35,568 INFO [Listener at localhost/45619] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-03-11 00:53:35,599 INFO [Listener at localhost/45619] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-11 00:53:35,599 INFO [Listener at localhost/45619] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-11 00:53:35,600 INFO [Listener at localhost/45619] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-11 00:53:35,600 INFO [Listener at localhost/45619] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-11 00:53:35,600 INFO [Listener at localhost/45619] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-11 00:53:35,748 INFO [Listener at localhost/45619] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-11 00:53:35,832 DEBUG [Listener at localhost/45619] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-11 00:53:35,926 INFO [Listener at localhost/45619] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40615 2023-03-11 00:53:35,938 INFO [Listener at localhost/45619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 00:53:35,940 INFO [Listener at localhost/45619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 00:53:35,960 INFO [Listener at localhost/45619] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40615 connecting to ZooKeeper ensemble=127.0.0.1:62412 2023-03-11 00:53:36,001 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:406150x0, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-11 00:53:36,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40615-0x100d11088a50000 connected 2023-03-11 00:53:36,031 DEBUG [Listener at localhost/45619] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-11 00:53:36,032 DEBUG [Listener at localhost/45619] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-11 00:53:36,036 DEBUG [Listener at localhost/45619] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-11 00:53:36,047 DEBUG [Listener at localhost/45619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40615 2023-03-11 00:53:36,047 DEBUG [Listener at localhost/45619] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40615 2023-03-11 00:53:36,048 DEBUG [Listener at localhost/45619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40615 2023-03-11 00:53:36,050 DEBUG [Listener at localhost/45619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40615 2023-03-11 00:53:36,050 DEBUG [Listener at localhost/45619] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40615 2023-03-11 00:53:36,057 INFO [Listener at localhost/45619] master.HMaster(444): hbase.rootdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6, hbase.cluster.distributed=false 2023-03-11 00:53:36,129 INFO [Listener at localhost/45619] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-03-11 00:53:36,130 INFO [Listener at localhost/45619] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-11 00:53:36,130 INFO [Listener at localhost/45619] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-11 00:53:36,130 INFO [Listener at localhost/45619] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-11 00:53:36,130 INFO [Listener at localhost/45619] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-11 00:53:36,130 INFO [Listener at localhost/45619] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-11 00:53:36,135 INFO [Listener at localhost/45619] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-11 00:53:36,138 INFO [Listener at localhost/45619] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38819 2023-03-11 00:53:36,140 INFO [Listener at localhost/45619] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-11 00:53:36,146 DEBUG [Listener at localhost/45619] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-11 00:53:36,147 INFO [Listener at localhost/45619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 00:53:36,150 INFO [Listener at localhost/45619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 00:53:36,151 INFO [Listener at localhost/45619] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38819 connecting to ZooKeeper ensemble=127.0.0.1:62412 2023-03-11 00:53:36,155 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:388190x0, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-11 00:53:36,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38819-0x100d11088a50001 connected 2023-03-11 00:53:36,156 DEBUG [Listener at localhost/45619] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-11 00:53:36,157 DEBUG [Listener at localhost/45619] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-11 00:53:36,158 DEBUG [Listener at localhost/45619] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-11 00:53:36,159 DEBUG [Listener at localhost/45619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38819 2023-03-11 00:53:36,163 DEBUG [Listener at localhost/45619] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38819 2023-03-11 00:53:36,163 DEBUG [Listener at localhost/45619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38819 2023-03-11 00:53:36,163 DEBUG [Listener at localhost/45619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38819 2023-03-11 00:53:36,164 DEBUG [Listener at localhost/45619] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38819 2023-03-11 00:53:36,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40615,1678496014902 2023-03-11 00:53:36,177 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-11 00:53:36,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40615,1678496014902 2023-03-11 00:53:36,196 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-11 00:53:36,196 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-11 00:53:36,196 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 00:53:36,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-11 00:53:36,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40615,1678496014902 from backup master directory 2023-03-11 00:53:36,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-11 00:53:36,202 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40615,1678496014902 2023-03-11 00:53:36,202 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-11 00:53:36,203 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-11 00:53:36,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40615,1678496014902 2023-03-11 00:53:36,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-11 00:53:36,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-11 00:53:36,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/hbase.id with ID: 75ea834b-2517-4dff-8a5f-65d7112832e0 2023-03-11 00:53:36,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 00:53:36,353 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 00:53:36,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x472ce7e8 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:53:36,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@379573c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:53:36,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-11 00:53:36,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-11 00:53:36,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-11 00:53:36,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-11 00:53:36,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-11 00:53:36,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-11 00:53:36,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-11 00:53:36,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/data/master/store-tmp 2023-03-11 00:53:36,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:36,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-11 00:53:36,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 00:53:36,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 00:53:36,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-11 00:53:36,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 00:53:36,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 00:53:36,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-11 00:53:36,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/WALs/jenkins-hbase4.apache.org,40615,1678496014902 2023-03-11 00:53:36,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40615%2C1678496014902, suffix=, logDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/WALs/jenkins-hbase4.apache.org,40615,1678496014902, archiveDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/oldWALs, maxLogs=10 2023-03-11 00:53:36,642 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37371,DS-e5ad0c0b-e69d-4451-8af5-d85aaf66d809,DISK] 2023-03-11 00:53:36,651 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-11 00:53:36,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/WALs/jenkins-hbase4.apache.org,40615,1678496014902/jenkins-hbase4.apache.org%2C40615%2C1678496014902.1678496016587 2023-03-11 00:53:36,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37371,DS-e5ad0c0b-e69d-4451-8af5-d85aaf66d809,DISK]] 2023-03-11 00:53:36,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:53:36,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:36,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-11 00:53:36,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-11 00:53:36,790 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-11 00:53:36,798 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-11 00:53:36,825 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-11 00:53:36,838 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:36,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-11 00:53:36,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-11 00:53:36,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-11 00:53:36,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:53:36,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74620780, jitterRate=0.11193627119064331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:53:36,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-11 00:53:36,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-11 00:53:36,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-11 00:53:36,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-11 00:53:36,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-11 00:53:36,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-11 00:53:36,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 32 msec 2023-03-11 00:53:36,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-11 00:53:36,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-11 00:53:36,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-11 00:53:36,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-11 00:53:36,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-11 00:53:36,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-11 00:53:36,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-11 00:53:36,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-11 00:53:37,002 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 00:53:37,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-11 00:53:37,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-11 00:53:37,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-11 00:53:37,025 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-11 00:53:37,025 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-11 00:53:37,025 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 00:53:37,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40615,1678496014902, sessionid=0x100d11088a50000, setting cluster-up flag (Was=false) 2023-03-11 00:53:37,042 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 00:53:37,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-11 00:53:37,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40615,1678496014902 2023-03-11 00:53:37,056 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 00:53:37,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-11 00:53:37,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40615,1678496014902 2023-03-11 00:53:37,067 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/.tmp 2023-03-11 00:53:37,168 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(952): ClusterId : 75ea834b-2517-4dff-8a5f-65d7112832e0 2023-03-11 00:53:37,174 DEBUG [RS:0;jenkins-hbase4:38819] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-11 00:53:37,183 DEBUG [RS:0;jenkins-hbase4:38819] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-11 00:53:37,183 DEBUG [RS:0;jenkins-hbase4:38819] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-11 00:53:37,190 DEBUG [RS:0;jenkins-hbase4:38819] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-11 00:53:37,191 DEBUG [RS:0;jenkins-hbase4:38819] zookeeper.ReadOnlyZKClient(139): Connect 0x6f0b533f to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:53:37,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-11 00:53:37,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-11 00:53:37,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-11 00:53:37,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-11 00:53:37,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-11 00:53:37,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-03-11 00:53:37,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-11 00:53:37,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,208 DEBUG [RS:0;jenkins-hbase4:38819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61cca0ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:53:37,215 DEBUG [RS:0;jenkins-hbase4:38819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65f3384f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-11 00:53:37,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1678496047217 2023-03-11 00:53:37,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-11 00:53:37,221 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-11 00:53:37,221 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-11 00:53:37,228 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-11 00:53:37,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-11 00:53:37,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-11 00:53:37,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-11 00:53:37,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-11 00:53:37,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-11 00:53:37,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:37,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-11 00:53:37,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-11 00:53:37,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-11 00:53:37,246 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38819 2023-03-11 00:53:37,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-11 00:53:37,252 INFO [RS:0;jenkins-hbase4:38819] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-11 00:53:37,252 INFO [RS:0;jenkins-hbase4:38819] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-11 00:53:37,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-11 00:53:37,252 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1023): About to register with Master. 2023-03-11 00:53:37,255 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40615,1678496014902 with isa=jenkins-hbase4.apache.org/172.31.14.131:38819, startcode=1678496016129 2023-03-11 00:53:37,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1678496017254,5,FailOnTimeoutGroup] 2023-03-11 00:53:37,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1678496017257,5,FailOnTimeoutGroup] 2023-03-11 00:53:37,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:37,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-11 00:53:37,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:37,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:37,272 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-11 00:53:37,273 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-11 00:53:37,274 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6 2023-03-11 00:53:37,281 DEBUG [RS:0;jenkins-hbase4:38819] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-11 00:53:37,286 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:37,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-11 00:53:37,291 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/info 2023-03-11 00:53:37,292 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-11 00:53:37,294 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:37,294 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-11 00:53:37,297 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/rep_barrier 2023-03-11 00:53:37,298 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-11 00:53:37,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:37,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-11 00:53:37,305 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/table 2023-03-11 00:53:37,306 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-11 00:53:37,307 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:37,312 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740 2023-03-11 00:53:37,313 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740 2023-03-11 00:53:37,318 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-11 00:53:37,320 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-11 00:53:37,325 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:53:37,326 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68361146, jitterRate=0.01866045594215393}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-11 00:53:37,326 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-11 00:53:37,327 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-11 00:53:37,327 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-11 00:53:37,327 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-11 00:53:37,327 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-11 00:53:37,327 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-11 00:53:37,328 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-11 00:53:37,329 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-11 00:53:37,334 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-11 00:53:37,334 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-11 00:53:37,339 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37019, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-11 00:53:37,343 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-11 00:53:37,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:37,358 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-11 00:53:37,361 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-11 00:53:37,373 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6 2023-03-11 00:53:37,373 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41469 2023-03-11 00:53:37,373 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-11 00:53:37,380 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-11 00:53:37,380 DEBUG [RS:0;jenkins-hbase4:38819] zookeeper.ZKUtil(162): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:37,380 WARN [RS:0;jenkins-hbase4:38819] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-11 00:53:37,381 INFO [RS:0;jenkins-hbase4:38819] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-11 00:53:37,381 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/WALs/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:37,382 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38819,1678496016129] 2023-03-11 00:53:37,391 DEBUG [RS:0;jenkins-hbase4:38819] zookeeper.ZKUtil(162): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:37,401 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-11 00:53:37,411 INFO [RS:0;jenkins-hbase4:38819] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-11 00:53:37,430 INFO [RS:0;jenkins-hbase4:38819] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-11 00:53:37,433 INFO [RS:0;jenkins-hbase4:38819] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:53:37,434 INFO [RS:0;jenkins-hbase4:38819] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:37,435 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-11 00:53:37,444 INFO [RS:0;jenkins-hbase4:38819] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-11 00:53:37,444 DEBUG [RS:0;jenkins-hbase4:38819] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,445 DEBUG [RS:0;jenkins-hbase4:38819] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,445 DEBUG [RS:0;jenkins-hbase4:38819] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,445 DEBUG [RS:0;jenkins-hbase4:38819] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,445 DEBUG [RS:0;jenkins-hbase4:38819] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,445 DEBUG [RS:0;jenkins-hbase4:38819] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-11 00:53:37,445 DEBUG [RS:0;jenkins-hbase4:38819] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,445 DEBUG [RS:0;jenkins-hbase4:38819] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,445 DEBUG [RS:0;jenkins-hbase4:38819] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,445 DEBUG [RS:0;jenkins-hbase4:38819] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-11 00:53:37,446 INFO [RS:0;jenkins-hbase4:38819] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:37,446 INFO [RS:0;jenkins-hbase4:38819] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:37,446 INFO [RS:0;jenkins-hbase4:38819] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:37,463 INFO [RS:0;jenkins-hbase4:38819] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-11 00:53:37,466 INFO [RS:0;jenkins-hbase4:38819] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38819,1678496016129-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:37,481 INFO [RS:0;jenkins-hbase4:38819] regionserver.Replication(203): jenkins-hbase4.apache.org,38819,1678496016129 started 2023-03-11 00:53:37,481 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38819,1678496016129, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38819, sessionid=0x100d11088a50001 2023-03-11 00:53:37,482 DEBUG [RS:0;jenkins-hbase4:38819] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-11 00:53:37,482 DEBUG [RS:0;jenkins-hbase4:38819] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:37,482 DEBUG [RS:0;jenkins-hbase4:38819] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38819,1678496016129' 2023-03-11 00:53:37,482 DEBUG [RS:0;jenkins-hbase4:38819] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:37,482 DEBUG [RS:0;jenkins-hbase4:38819] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:37,483 DEBUG [RS:0;jenkins-hbase4:38819] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-11 00:53:37,483 DEBUG [RS:0;jenkins-hbase4:38819] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-11 00:53:37,483 DEBUG [RS:0;jenkins-hbase4:38819] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:37,483 DEBUG [RS:0;jenkins-hbase4:38819] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38819,1678496016129' 2023-03-11 00:53:37,483 DEBUG [RS:0;jenkins-hbase4:38819] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-11 00:53:37,483 DEBUG [RS:0;jenkins-hbase4:38819] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-11 00:53:37,484 DEBUG [RS:0;jenkins-hbase4:38819] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-11 00:53:37,484 INFO [RS:0;jenkins-hbase4:38819] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-11 00:53:37,484 INFO [RS:0;jenkins-hbase4:38819] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-11 00:53:37,513 DEBUG [jenkins-hbase4:40615] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-11 00:53:37,516 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38819,1678496016129, state=OPENING 2023-03-11 00:53:37,524 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-11 00:53:37,526 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 00:53:37,527 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-11 00:53:37,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:53:37,595 INFO [RS:0;jenkins-hbase4:38819] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38819%2C1678496016129, suffix=, logDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/WALs/jenkins-hbase4.apache.org,38819,1678496016129, archiveDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/oldWALs, maxLogs=32 2023-03-11 00:53:37,614 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37371,DS-e5ad0c0b-e69d-4451-8af5-d85aaf66d809,DISK] 2023-03-11 00:53:37,619 INFO [RS:0;jenkins-hbase4:38819] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/WALs/jenkins-hbase4.apache.org,38819,1678496016129/jenkins-hbase4.apache.org%2C38819%2C1678496016129.1678496017599 2023-03-11 00:53:37,620 DEBUG [RS:0;jenkins-hbase4:38819] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37371,DS-e5ad0c0b-e69d-4451-8af5-d85aaf66d809,DISK]] 2023-03-11 00:53:37,717 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:37,721 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-11 00:53:37,725 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47654, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-11 00:53:37,737 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-11 00:53:37,737 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-11 00:53:37,742 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38819%2C1678496016129.meta, suffix=.meta, logDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/WALs/jenkins-hbase4.apache.org,38819,1678496016129, archiveDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/oldWALs, maxLogs=32 2023-03-11 00:53:37,762 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37371,DS-e5ad0c0b-e69d-4451-8af5-d85aaf66d809,DISK] 2023-03-11 00:53:37,767 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/WALs/jenkins-hbase4.apache.org,38819,1678496016129/jenkins-hbase4.apache.org%2C38819%2C1678496016129.meta.1678496017744.meta 2023-03-11 00:53:37,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37371,DS-e5ad0c0b-e69d-4451-8af5-d85aaf66d809,DISK]] 2023-03-11 00:53:37,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:53:37,770 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-11 00:53:37,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-11 00:53:37,793 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-11 00:53:37,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-11 00:53:37,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:37,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-11 00:53:37,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-11 00:53:37,803 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-11 00:53:37,805 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/info 2023-03-11 00:53:37,805 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/info 2023-03-11 00:53:37,806 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-11 00:53:37,807 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:37,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-11 00:53:37,810 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/rep_barrier 2023-03-11 00:53:37,810 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/rep_barrier 2023-03-11 00:53:37,811 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-11 00:53:37,812 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:37,813 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-11 00:53:37,814 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/table 2023-03-11 00:53:37,814 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/table 2023-03-11 00:53:37,815 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-11 00:53:37,816 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:37,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740 2023-03-11 00:53:37,821 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740 2023-03-11 00:53:37,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-11 00:53:37,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-11 00:53:37,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73162158, jitterRate=0.09020110964775085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-11 00:53:37,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-11 00:53:37,840 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1678496017707 2023-03-11 00:53:37,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-11 00:53:37,861 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-11 00:53:37,861 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38819,1678496016129, state=OPEN 2023-03-11 00:53:37,864 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-11 00:53:37,864 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-11 00:53:37,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-11 00:53:37,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38819,1678496016129 in 335 msec 2023-03-11 00:53:37,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-11 00:53:37,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 527 msec 2023-03-11 00:53:37,882 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 769 msec 2023-03-11 00:53:37,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1678496017882, completionTime=-1 2023-03-11 00:53:37,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-11 00:53:37,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-03-11 00:53:37,958 DEBUG [hconnection-0x33f57e7d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:53:37,963 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47656, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:53:37,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-03-11 00:53:37,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1678496077983 2023-03-11 00:53:37,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1678496137983 2023-03-11 00:53:37,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 100 msec 2023-03-11 00:53:38,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40615,1678496014902-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:38,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40615,1678496014902-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:38,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40615,1678496014902-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:38,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40615, period=300000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:38,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-11 00:53:38,018 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-11 00:53:38,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-11 00:53:38,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-11 00:53:38,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-11 00:53:38,046 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:53:38,049 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:53:38,073 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:53:38,075 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261 empty. 2023-03-11 00:53:38,076 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:53:38,076 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-11 00:53:38,499 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-11 00:53:38,501 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9f98d24cb38e778755e7bb1a46a77261, NAME => 'hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:53:38,512 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:38,512 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 9f98d24cb38e778755e7bb1a46a77261, disabling compactions & flushes 2023-03-11 00:53:38,512 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:53:38,512 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:53:38,513 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. after waiting 0 ms 2023-03-11 00:53:38,513 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:53:38,513 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:53:38,513 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 9f98d24cb38e778755e7bb1a46a77261: 2023-03-11 00:53:38,517 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:53:38,535 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678496018520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496018520"}]},"ts":"1678496018520"} 2023-03-11 00:53:38,563 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 00:53:38,565 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:53:38,569 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496018565"}]},"ts":"1678496018565"} 2023-03-11 00:53:38,573 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-11 00:53:38,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9f98d24cb38e778755e7bb1a46a77261, ASSIGN}] 2023-03-11 00:53:38,586 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9f98d24cb38e778755e7bb1a46a77261, ASSIGN 2023-03-11 00:53:38,588 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9f98d24cb38e778755e7bb1a46a77261, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:53:38,739 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9f98d24cb38e778755e7bb1a46a77261, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:38,740 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678496018739"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496018739"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496018739"}]},"ts":"1678496018739"} 2023-03-11 00:53:38,745 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9f98d24cb38e778755e7bb1a46a77261, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:53:38,906 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:53:38,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f98d24cb38e778755e7bb1a46a77261, NAME => 'hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:53:38,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:53:38,908 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:38,908 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:53:38,908 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:53:38,911 INFO [StoreOpener-9f98d24cb38e778755e7bb1a46a77261-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:53:38,914 DEBUG [StoreOpener-9f98d24cb38e778755e7bb1a46a77261-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261/info 2023-03-11 00:53:38,914 DEBUG [StoreOpener-9f98d24cb38e778755e7bb1a46a77261-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261/info 2023-03-11 00:53:38,914 INFO [StoreOpener-9f98d24cb38e778755e7bb1a46a77261-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f98d24cb38e778755e7bb1a46a77261 columnFamilyName info 2023-03-11 00:53:38,915 INFO [StoreOpener-9f98d24cb38e778755e7bb1a46a77261-1] regionserver.HStore(310): Store=9f98d24cb38e778755e7bb1a46a77261/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:38,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:53:38,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:53:38,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:53:38,925 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:53:38,926 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f98d24cb38e778755e7bb1a46a77261; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64668653, jitterRate=-0.03636197745800018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:53:38,926 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f98d24cb38e778755e7bb1a46a77261: 2023-03-11 00:53:38,928 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261., pid=6, masterSystemTime=1678496018899 2023-03-11 00:53:38,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:53:38,932 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:53:38,934 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9f98d24cb38e778755e7bb1a46a77261, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:38,934 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678496018933"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496018933"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496018933"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496018933"}]},"ts":"1678496018933"} 2023-03-11 00:53:38,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-11 00:53:38,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9f98d24cb38e778755e7bb1a46a77261, server=jenkins-hbase4.apache.org,38819,1678496016129 in 193 msec 2023-03-11 00:53:38,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-11 00:53:38,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9f98d24cb38e778755e7bb1a46a77261, ASSIGN in 358 msec 2023-03-11 00:53:38,946 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:53:38,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496018946"}]},"ts":"1678496018946"} 2023-03-11 00:53:38,949 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-11 00:53:38,952 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:53:38,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 921 msec 2023-03-11 00:53:39,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-11 00:53:39,048 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-11 00:53:39,048 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 00:53:39,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-11 00:53:39,104 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-11 00:53:39,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-03-11 00:53:39,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-11 00:53:39,132 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-11 00:53:39,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-03-11 00:53:39,146 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-11 00:53:39,148 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-11 00:53:39,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.945sec 2023-03-11 00:53:39,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-11 00:53:39,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-11 00:53:39,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-11 00:53:39,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40615,1678496014902-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-11 00:53:39,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40615,1678496014902-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-11 00:53:39,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-11 00:53:39,173 DEBUG [Listener at localhost/45619] zookeeper.ReadOnlyZKClient(139): Connect 0x0672b468 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:53:39,178 DEBUG [Listener at localhost/45619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@561bf69b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:53:39,190 DEBUG [hconnection-0x78f916d2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:53:39,203 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:53:39,215 INFO [Listener at localhost/45619] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40615,1678496014902 2023-03-11 00:53:39,217 DEBUG [Listener at localhost/45619] zookeeper.ReadOnlyZKClient(139): Connect 0x33fc1e18 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:53:39,222 DEBUG [Listener at localhost/45619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b586bb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:53:39,222 INFO [Listener at localhost/45619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 00:53:39,249 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=170, AvailableMemoryMB=5720 2023-03-11 00:53:39,261 DEBUG [Listener at localhost/45619] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:53:39,266 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56108, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:53:39,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 00:53:39,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:39,286 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:53:39,289 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:53:39,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-11 00:53:39,292 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:39,293 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e empty. 2023-03-11 00:53:39,295 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:39,295 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-11 00:53:39,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-11 00:53:39,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-11 00:53:39,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-11 00:53:39,715 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-11 00:53:39,718 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 36cfe1c0fa36465e8e4065cb6f4feb3e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:53:39,730 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:39,730 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 36cfe1c0fa36465e8e4065cb6f4feb3e, disabling compactions & flushes 2023-03-11 00:53:39,730 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:39,730 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:39,730 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. after waiting 0 ms 2023-03-11 00:53:39,730 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:39,730 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:39,731 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:39,735 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:53:39,736 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678496019736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496019736"}]},"ts":"1678496019736"} 2023-03-11 00:53:39,739 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 00:53:39,740 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:53:39,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496019740"}]},"ts":"1678496019740"} 2023-03-11 00:53:39,743 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-11 00:53:39,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=36cfe1c0fa36465e8e4065cb6f4feb3e, ASSIGN}] 2023-03-11 00:53:39,749 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=36cfe1c0fa36465e8e4065cb6f4feb3e, ASSIGN 2023-03-11 00:53:39,751 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=36cfe1c0fa36465e8e4065cb6f4feb3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:53:39,902 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=36cfe1c0fa36465e8e4065cb6f4feb3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:39,903 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678496019902"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496019902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496019902"}]},"ts":"1678496019902"} 2023-03-11 00:53:39,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 36cfe1c0fa36465e8e4065cb6f4feb3e, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:53:39,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-11 00:53:40,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:40,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 36cfe1c0fa36465e8e4065cb6f4feb3e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:53:40,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:40,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:40,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:40,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:40,069 INFO [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:40,071 DEBUG [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1 2023-03-11 00:53:40,071 DEBUG [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1 2023-03-11 00:53:40,074 INFO [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36cfe1c0fa36465e8e4065cb6f4feb3e columnFamilyName family1 2023-03-11 00:53:40,077 INFO [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] regionserver.HStore(310): Store=36cfe1c0fa36465e8e4065cb6f4feb3e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:40,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:40,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:40,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:40,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:53:40,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 36cfe1c0fa36465e8e4065cb6f4feb3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59605885, jitterRate=-0.1118030995130539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:53:40,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:40,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e., pid=11, masterSystemTime=1678496020059 2023-03-11 00:53:40,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:40,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:40,097 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=36cfe1c0fa36465e8e4065cb6f4feb3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:40,098 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678496020097"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496020097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496020097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496020097"}]},"ts":"1678496020097"} 2023-03-11 00:53:40,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-11 00:53:40,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 36cfe1c0fa36465e8e4065cb6f4feb3e, server=jenkins-hbase4.apache.org,38819,1678496016129 in 195 msec 2023-03-11 00:53:40,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-11 00:53:40,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=36cfe1c0fa36465e8e4065cb6f4feb3e, ASSIGN in 358 msec 2023-03-11 00:53:40,110 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:53:40,110 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496020110"}]},"ts":"1678496020110"} 2023-03-11 00:53:40,113 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-11 00:53:40,117 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:53:40,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 835 msec 2023-03-11 00:53:40,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-11 00:53:40,414 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-11 00:53:40,431 DEBUG [hconnection-0x7aa6bd5c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:53:40,434 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:53:40,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:40,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:40,588 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:40,588 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:40,589 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 00:53:40,589 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 00:53:40,589 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:40,589 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:40,591 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:40,591 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:40,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:40,592 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:40,592 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:40,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:40,593 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:40,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:40,596 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 00:53:40,596 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:40,597 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 00:53:40,597 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:40,597 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:40,597 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:40,598 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. started... 2023-03-11 00:53:40,599 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 36cfe1c0fa36465e8e4065cb6f4feb3e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 00:53:41,143 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130cd905d3486a64bbab4e33ac4f2df776f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130cd905d3486a64bbab4e33ac4f2df776f 2023-03-11 00:53:41,558 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/15e345de2d2f4f9886c8e494b5a32b13 2023-03-11 00:53:41,568 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/15e345de2d2f4f9886c8e494b5a32b13 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/15e345de2d2f4f9886c8e494b5a32b13 2023-03-11 00:53:41,576 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/15e345de2d2f4f9886c8e494b5a32b13, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-11 00:53:41,579 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 36cfe1c0fa36465e8e4065cb6f4feb3e in 980ms, sequenceid=5, compaction requested=false 2023-03-11 00:53:41,580 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:41,582 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:41,583 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:41,583 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:41,583 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:41,583 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,583 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 00:53:41,583 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 00:53:41,587 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,587 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:41,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:41,587 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,587 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:41,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:41,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:41,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:41,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 00:53:41,589 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 00:53:41,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bb974df[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:41,589 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,592 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,592 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 00:53:41,592 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 00:53:41,592 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:41,592 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,592 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:41,595 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,595 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 00:53:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:41,595 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:41,595 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 00:53:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:41,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 00:53:41,598 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 00:53:41,598 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:41,598 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:41,598 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,598 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:41,601 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,601 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:41,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,601 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:41,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:41,602 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,603 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,611 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,611 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:41,611 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:41,611 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:41,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:41,611 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,611 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:41,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:41,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:41,611 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,612 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,612 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,612 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:41,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:41,613 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:41,614 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:41,714 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:41,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:41,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:41,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:41,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,731 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:41,731 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:41,732 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 00:53:41,732 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 00:53:41,733 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,733 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,735 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:41,735 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:41,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:41,736 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:41,736 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:41,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:41,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,737 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,737 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 00:53:41,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:41,737 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 00:53:41,737 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:41,738 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 00:53:41,738 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:41,738 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:41,738 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:41,738 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. started... 2023-03-11 00:53:41,738 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 36cfe1c0fa36465e8e4065cb6f4feb3e 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 00:53:42,163 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289541beb91acf4984b19d411c7680a445 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511289541beb91acf4984b19d411c7680a445 2023-03-11 00:53:42,574 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/7dc32501e2ea4cdc860756c149236aa6 2023-03-11 00:53:42,582 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/7dc32501e2ea4cdc860756c149236aa6 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/7dc32501e2ea4cdc860756c149236aa6 2023-03-11 00:53:42,590 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/7dc32501e2ea4cdc860756c149236aa6, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 00:53:42,592 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 36cfe1c0fa36465e8e4065cb6f4feb3e in 854ms, sequenceid=9, compaction requested=false 2023-03-11 00:53:42,593 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:42,593 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 00:53:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 00:53:42,596 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,596 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:42,596 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,596 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:42,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 00:53:42,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35da58e6[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:42,599 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 00:53:42,599 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,600 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,601 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 00:53:42,601 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 00:53:42,601 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:42,601 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,601 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:42,602 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 00:53:42,603 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,603 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:42,603 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 00:53:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:42,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:42,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:42,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:42,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 00:53:42,606 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 00:53:42,606 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:42,606 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:42,606 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,606 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:42,612 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,612 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,613 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:42,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:42,613 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,615 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:42,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:42,619 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:42,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 00:53:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:42,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:42,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:42,619 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,619 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:42,619 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,619 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,619 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:42,620 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:42,620 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:42,720 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:42,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:42,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:42,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:42,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,732 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:42,732 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:42,732 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 00:53:42,732 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 00:53:42,733 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,733 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,735 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:42,735 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:42,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:42,735 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:42,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,735 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:42,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:42,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,736 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,736 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 00:53:42,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:42,736 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 00:53:42,737 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:42,737 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 00:53:42,737 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:42,737 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:42,737 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:42,737 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. started... 2023-03-11 00:53:42,737 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 36cfe1c0fa36465e8e4065cb6f4feb3e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:43,166 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018469e0f6e08347a4b905b6ce59aca1d4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512018469e0f6e08347a4b905b6ce59aca1d4 2023-03-11 00:53:43,318 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:53:43,406 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-11 00:53:43,408 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-11 00:53:43,578 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/bc8e7df9de8e41b8b040af4d4b237de9 2023-03-11 00:53:43,588 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/bc8e7df9de8e41b8b040af4d4b237de9 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bc8e7df9de8e41b8b040af4d4b237de9 2023-03-11 00:53:43,596 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bc8e7df9de8e41b8b040af4d4b237de9, entries=1, sequenceid=13, filesize=5.0 K 2023-03-11 00:53:43,597 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36cfe1c0fa36465e8e4065cb6f4feb3e in 860ms, sequenceid=13, compaction requested=true 2023-03-11 00:53:43,597 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:43,597 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:43,597 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:43,598 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:43,598 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,598 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 00:53:43,598 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 00:53:43,600 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,600 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:43,601 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,601 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:43,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 00:53:43,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ada6437[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:43,603 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 00:53:43,603 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,605 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,606 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 00:53:43,606 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 00:53:43,606 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:43,606 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,606 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:43,607 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 00:53:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 00:53:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:43,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:43,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 00:53:43,612 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 00:53:43,612 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:43,612 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:43,612 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,612 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:43,614 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,614 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,614 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:43,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:43,616 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,618 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,622 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,622 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:43,622 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:43,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 00:53:43,622 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,622 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:43,623 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:43,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:43,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:43,622 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:43,623 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,623 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,623 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,624 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:43,624 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:43,724 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:43,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:43,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:43,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:43,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,740 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:43,740 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:43,740 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 00:53:43,740 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 00:53:43,741 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,741 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,743 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:43,743 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:43,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:43,743 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:43,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,743 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:43,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:43,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,744 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,745 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 00:53:43,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:43,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 00:53:43,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:43,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 00:53:43,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:43,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:43,745 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:43,746 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. started... 2023-03-11 00:53:43,746 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 36cfe1c0fa36465e8e4065cb6f4feb3e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:44,178 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b416df7e2f98406f88c9f8e3713125d2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b416df7e2f98406f88c9f8e3713125d2 2023-03-11 00:53:44,593 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/bb450a84140c415ab93ba022877f6c6c 2023-03-11 00:53:44,603 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/bb450a84140c415ab93ba022877f6c6c as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bb450a84140c415ab93ba022877f6c6c 2023-03-11 00:53:44,613 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bb450a84140c415ab93ba022877f6c6c, entries=1, sequenceid=17, filesize=5.0 K 2023-03-11 00:53:44,614 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36cfe1c0fa36465e8e4065cb6f4feb3e in 868ms, sequenceid=17, compaction requested=true 2023-03-11 00:53:44,614 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:44,614 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:44,614 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:44,617 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:44,617 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,617 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 00:53:44,617 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 00:53:44,619 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,619 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:44,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:44,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:44,625 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,625 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:44,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:44,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:44,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 00:53:44,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@778f1f08[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:44,627 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 00:53:44,627 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,630 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,630 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 00:53:44,630 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,630 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:44,630 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 00:53:44,630 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:44,632 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,632 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 00:53:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:44,632 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:44,633 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 00:53:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:44,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:44,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 00:53:44,637 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 00:53:44,637 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:44,637 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:44,637 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,637 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:44,639 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,639 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:44,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:44,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,640 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:44,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:44,640 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:44,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:44,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:44,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,643 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:44,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,649 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:44,649 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:44,649 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,649 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,649 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 00:53:44,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:44,649 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:44,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:44,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:44,649 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:44,649 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,651 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:44,651 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,651 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:44,651 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:44,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:44,751 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:44,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:44,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:44,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:44,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,762 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:44,763 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:44,763 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 00:53:44,763 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 00:53:44,764 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,764 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,765 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:44,765 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:44,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:44,766 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:44,766 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:44,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:44,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,767 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 00:53:44,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:44,767 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 00:53:44,767 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:44,767 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 00:53:44,767 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:44,767 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:44,768 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:44,768 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. started... 2023-03-11 00:53:44,768 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 36cfe1c0fa36465e8e4065cb6f4feb3e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:45,075 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-11 00:53:45,075 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-11 00:53:45,190 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122863a293d91fde4cd8b9881ddea9cbc017 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122863a293d91fde4cd8b9881ddea9cbc017 2023-03-11 00:53:45,602 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/73fc6a273cb646a9af4708ea17984110 2023-03-11 00:53:45,611 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/73fc6a273cb646a9af4708ea17984110 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/73fc6a273cb646a9af4708ea17984110 2023-03-11 00:53:45,620 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/73fc6a273cb646a9af4708ea17984110, entries=1, sequenceid=21, filesize=5.0 K 2023-03-11 00:53:45,622 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36cfe1c0fa36465e8e4065cb6f4feb3e in 854ms, sequenceid=21, compaction requested=true 2023-03-11 00:53:45,622 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:45,622 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 00:53:45,623 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 00:53:45,632 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,632 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:45,633 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,633 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:45,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 00:53:45,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@678082aa[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:45,634 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 00:53:45,634 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,636 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,636 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 00:53:45,636 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 00:53:45,636 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:45,636 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,636 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:45,638 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 00:53:45,638 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,638 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:45,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,638 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 00:53:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:45,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:45,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:45,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 00:53:45,642 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 00:53:45,642 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:45,642 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:45,642 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,642 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:45,644 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,644 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:45,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:45,644 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:45,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,645 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:45,646 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,650 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,650 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:45,650 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,650 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:45,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:45,651 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:45,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:45,650 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:45,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:45,651 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,651 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,651 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,651 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 00:53:45,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:45,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:45,652 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:45,652 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:45,752 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:45,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:45,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:45,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:45,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,763 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:45,763 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:45,764 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 00:53:45,764 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 00:53:45,765 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,765 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,766 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:45,766 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:45,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:45,767 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:45,767 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:45,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:45,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,768 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,768 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 00:53:45,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:45,768 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 00:53:45,768 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:45,769 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 00:53:45,769 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:45,769 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:45,769 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:45,769 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. started... 2023-03-11 00:53:45,769 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 36cfe1c0fa36465e8e4065cb6f4feb3e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:46,200 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a73a0bc81b96456dad5d52db151c56e9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a73a0bc81b96456dad5d52db151c56e9 2023-03-11 00:53:46,211 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/972f1169d36242f39287c1c213243666 2023-03-11 00:53:46,219 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/972f1169d36242f39287c1c213243666 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/972f1169d36242f39287c1c213243666 2023-03-11 00:53:46,227 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/972f1169d36242f39287c1c213243666, entries=1, sequenceid=25, filesize=5.0 K 2023-03-11 00:53:46,229 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36cfe1c0fa36465e8e4065cb6f4feb3e in 460ms, sequenceid=25, compaction requested=true 2023-03-11 00:53:46,229 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:46,229 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:46,229 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:46,230 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:46,230 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,230 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 00:53:46,230 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 00:53:46,232 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,232 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:46,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:46,233 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,233 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:46,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:46,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:46,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:46,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 00:53:46,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7afbd4[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:46,235 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 00:53:46,235 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,237 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,237 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 00:53:46,237 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 00:53:46,237 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:46,237 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,237 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:46,239 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 00:53:46,239 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,239 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:46,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:46,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:46,239 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 00:53:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:46,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:46,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 00:53:46,242 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 00:53:46,242 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:46,242 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:46,242 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,242 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:46,244 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,244 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:46,244 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:46,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:46,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:46,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:46,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,245 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:46,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:46,247 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,251 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:46,251 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:46,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:46,252 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:46,251 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:46,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:46,252 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:46,252 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,252 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,252 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,252 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,252 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,252 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:46,252 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:46,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:46,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:46,353 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:46,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:46,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:46,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:46,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,366 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:46,366 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:46,366 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 00:53:46,366 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 00:53:46,367 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,367 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,369 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:46,369 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:46,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:46,370 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:46,370 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:46,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:46,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,372 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,372 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 00:53:46,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:46,372 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 00:53:46,372 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:46,373 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 00:53:46,373 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:46,373 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:46,373 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:46,373 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. started... 2023-03-11 00:53:46,373 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 36cfe1c0fa36465e8e4065cb6f4feb3e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:46,801 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c578ea71b5cc4fcab0bda7e93722c891 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101c578ea71b5cc4fcab0bda7e93722c891 2023-03-11 00:53:47,264 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/3f14af22d5a24fa2a6fa8312d66b763b 2023-03-11 00:53:47,272 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/3f14af22d5a24fa2a6fa8312d66b763b as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/3f14af22d5a24fa2a6fa8312d66b763b 2023-03-11 00:53:47,282 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/3f14af22d5a24fa2a6fa8312d66b763b, entries=1, sequenceid=29, filesize=5.0 K 2023-03-11 00:53:47,283 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36cfe1c0fa36465e8e4065cb6f4feb3e in 910ms, sequenceid=29, compaction requested=true 2023-03-11 00:53:47,284 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:47,284 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 00:53:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 00:53:47,288 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:47,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:47,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 00:53:47,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6968cc30[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:47,291 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 00:53:47,291 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,292 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,293 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 00:53:47,293 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 00:53:47,293 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:47,293 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,293 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:47,294 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 00:53:47,294 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:47,294 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,294 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 00:53:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:47,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 00:53:47,298 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 00:53:47,298 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:47,298 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:47,298 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,298 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:47,299 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,299 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:47,299 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:47,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:47,300 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,301 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:47,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:47,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:47,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:47,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:47,311 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:47,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,312 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 00:53:47,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:47,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:47,312 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,312 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,312 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,312 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:47,312 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:47,413 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:47,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:47,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:47,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:47,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,424 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:47,424 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:47,424 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 00:53:47,424 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 00:53:47,425 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,425 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,426 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:47,426 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:47,426 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:47,426 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,427 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,428 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 00:53:47,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:47,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 00:53:47,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:47,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 00:53:47,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:47,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:47,428 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:47,429 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. started... 2023-03-11 00:53:47,429 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 36cfe1c0fa36465e8e4065cb6f4feb3e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:47,850 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033a6c20387dec4e5eb55e4d260910ec71 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601033a6c20387dec4e5eb55e4d260910ec71 2023-03-11 00:53:48,260 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/ebc8adf4cf974f4ea1768da8cb26137e 2023-03-11 00:53:48,270 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/ebc8adf4cf974f4ea1768da8cb26137e as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/ebc8adf4cf974f4ea1768da8cb26137e 2023-03-11 00:53:48,278 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/ebc8adf4cf974f4ea1768da8cb26137e, entries=1, sequenceid=33, filesize=5.0 K 2023-03-11 00:53:48,279 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36cfe1c0fa36465e8e4065cb6f4feb3e in 850ms, sequenceid=33, compaction requested=true 2023-03-11 00:53:48,280 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:48,280 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:48,280 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:48,280 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:48,280 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,281 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 00:53:48,281 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 00:53:48,282 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,282 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:48,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:48,283 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,283 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:48,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:48,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:48,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:48,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 00:53:48,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6610e94a[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:48,285 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 00:53:48,285 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,288 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,288 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 00:53:48,288 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 00:53:48,288 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:48,289 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,289 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:48,290 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 00:53:48,290 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:48,290 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,290 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 00:53:48,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:48,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:48,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:48,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:48,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:48,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 00:53:48,294 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 00:53:48,294 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:48,294 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:48,294 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,294 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:48,301 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,301 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:48,301 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:48,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:48,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,302 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,303 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:48,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,306 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,306 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,306 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,307 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:48,307 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:48,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:48,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:48,307 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,307 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,307 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,307 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:48,307 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 00:53:48,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:48,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:48,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:48,308 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:48,308 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:48,409 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:48,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:48,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:48,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:48,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,419 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:48,419 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:48,420 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 00:53:48,420 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 00:53:48,420 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,420 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,422 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,422 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:48,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:48,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:48,422 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:48,422 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:48,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:48,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,423 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,423 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 00:53:48,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:48,424 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 00:53:48,424 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 00:53:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:48,425 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:48,425 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. started... 2023-03-11 00:53:48,425 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 36cfe1c0fa36465e8e4065cb6f4feb3e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:48,844 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090792205d6ef20947b9a540f4abe9c38fe6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090792205d6ef20947b9a540f4abe9c38fe6 2023-03-11 00:53:49,253 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/a090af54325f4826acaf5e999f7df219 2023-03-11 00:53:49,262 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/a090af54325f4826acaf5e999f7df219 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/a090af54325f4826acaf5e999f7df219 2023-03-11 00:53:49,270 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/a090af54325f4826acaf5e999f7df219, entries=1, sequenceid=37, filesize=5.0 K 2023-03-11 00:53:49,271 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36cfe1c0fa36465e8e4065cb6f4feb3e in 846ms, sequenceid=37, compaction requested=true 2023-03-11 00:53:49,271 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:49,271 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:49,272 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:49,272 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:49,272 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,272 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 00:53:49,272 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 00:53:49,274 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,274 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:49,275 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,275 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:49,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 00:53:49,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e6a2f0[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:49,276 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 00:53:49,276 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,278 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,278 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 00:53:49,278 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 00:53:49,278 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:49,278 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,278 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:49,281 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,281 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 00:53:49,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:49,281 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:49,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:49,281 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 00:53:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:49,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 00:53:49,285 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 00:53:49,285 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:49,285 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:49,285 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,285 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:49,287 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,287 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,287 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:49,288 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:49,289 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,292 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,292 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,292 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:49,292 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:49,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:49,292 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:49,292 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:49,292 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:49,292 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,293 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,293 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:49,293 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,293 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:49,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 00:53:49,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:49,394 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:49,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:49,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:49,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:49,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,405 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:49,405 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:49,406 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 00:53:49,406 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 00:53:49,406 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,406 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,409 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:49,409 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:49,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:49,409 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,409 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:49,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:49,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,410 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,410 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 00:53:49,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,410 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 00:53:49,411 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:49,412 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 00:53:49,412 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:49,412 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:49,412 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:49,412 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. started... 2023-03-11 00:53:49,412 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 36cfe1c0fa36465e8e4065cb6f4feb3e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:49,836 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204071bd36b6cd492f84a760d35083eb6c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511204071bd36b6cd492f84a760d35083eb6c 2023-03-11 00:53:49,848 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/8431608d9d73458292f6151f44bbd643 2023-03-11 00:53:49,855 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/8431608d9d73458292f6151f44bbd643 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/8431608d9d73458292f6151f44bbd643 2023-03-11 00:53:49,861 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/8431608d9d73458292f6151f44bbd643, entries=1, sequenceid=41, filesize=5.0 K 2023-03-11 00:53:49,863 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36cfe1c0fa36465e8e4065cb6f4feb3e in 451ms, sequenceid=41, compaction requested=true 2023-03-11 00:53:49,863 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:49,863 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:49,863 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:49,863 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:49,863 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,863 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 00:53:49,863 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 00:53:49,866 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,866 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:49,866 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,866 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:49,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:49,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 00:53:49,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52155dc3[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:49,867 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 00:53:49,868 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,869 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 00:53:49,869 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,869 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 00:53:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:49,874 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,874 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 00:53:49,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:49,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:49,875 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:49,875 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 00:53:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:49,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 00:53:49,878 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 00:53:49,879 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:49,879 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:49,879 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,879 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:49,881 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,881 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:49,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,881 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:49,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:49,881 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,882 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,885 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,885 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,885 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:49,885 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:49,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 00:53:49,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:49,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:49,885 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:49,885 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:49,885 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:49,885 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,886 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,886 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:49,886 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:49,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:49,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 00:53:49,886 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:49,986 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:49,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:49,992 DEBUG [Listener at localhost/45619] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-11 00:53:49,995 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37318, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-11 00:53:49,997 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:50,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 00:53:50,010 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 00:53:50,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:53:50,011 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496630011 2023-03-11 00:53:50,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:53:50,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-11 00:53:50,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 00:53:50,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x69fb9fc7 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:53:50,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f118be1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:53:50,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:50,907 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103641ca5c0e4354f9bbded7c3e550cc781 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103641ca5c0e4354f9bbded7c3e550cc781 2023-03-11 00:53:50,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 00:53:50,926 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:53:50,927 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44584, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:53:50,937 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:53:50,939 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37328, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:53:50,972 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e9bd52ac0cc441cd88fad3a20126a7fa first=Optional[r3] last=Optional[r6] 2023-03-11 00:53:50,984 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e9bd52ac0cc441cd88fad3a20126a7fa}] 2023-03-11 00:53:50,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e9bd52ac0cc441cd88fad3a20126a7fa for inclusion in 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 2023-03-11 00:53:51,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-11 00:53:51,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:53:51,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:51,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e9bd52ac0cc441cd88fad3a20126a7fa to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bvabfs9ratgb1jh6ptk32snssagpmhhh8s9uf1fdpnhsg2h8j7kj0ct3vhgu90oc/family1/e9bd52ac0cc441cd88fad3a20126a7fa 2023-03-11 00:53:51,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bvabfs9ratgb1jh6ptk32snssagpmhhh8s9uf1fdpnhsg2h8j7kj0ct3vhgu90oc/family1/e9bd52ac0cc441cd88fad3a20126a7fa as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/03628c802d244d5a9c81c5b7ad3cad3a_SeqId_44_ 2023-03-11 00:53:51,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bvabfs9ratgb1jh6ptk32snssagpmhhh8s9uf1fdpnhsg2h8j7kj0ct3vhgu90oc/family1/e9bd52ac0cc441cd88fad3a20126a7fa into 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/03628c802d244d5a9c81c5b7ad3cad3a_SeqId_44_ - updating store file list. 2023-03-11 00:53:51,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/03628c802d244d5a9c81c5b7ad3cad3a_SeqId_44_ into 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 2023-03-11 00:53:51,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bvabfs9ratgb1jh6ptk32snssagpmhhh8s9uf1fdpnhsg2h8j7kj0ct3vhgu90oc/family1/e9bd52ac0cc441cd88fad3a20126a7fa into 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/03628c802d244d5a9c81c5b7ad3cad3a_SeqId_44_) 2023-03-11 00:53:51,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bvabfs9ratgb1jh6ptk32snssagpmhhh8s9uf1fdpnhsg2h8j7kj0ct3vhgu90oc/family1/e9bd52ac0cc441cd88fad3a20126a7fa 2023-03-11 00:53:51,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 00:53:51,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 00:53:51,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 is initiating minor compaction 2023-03-11 00:53:51,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@70bffa5e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:53:51,030 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:51,031 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/7dc32501e2ea4cdc860756c149236aa6, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bc8e7df9de8e41b8b040af4d4b237de9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bb450a84140c415ab93ba022877f6c6c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/73fc6a273cb646a9af4708ea17984110, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/972f1169d36242f39287c1c213243666, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/3f14af22d5a24fa2a6fa8312d66b763b, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/ebc8adf4cf974f4ea1768da8cb26137e, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/a090af54325f4826acaf5e999f7df219, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/8431608d9d73458292f6151f44bbd643, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/03628c802d244d5a9c81c5b7ad3cad3a_SeqId_44_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp, totalSize=50.2 K 2023-03-11 00:53:51,032 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 7dc32501e2ea4cdc860756c149236aa6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 00:53:51,032 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting bc8e7df9de8e41b8b040af4d4b237de9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 00:53:51,032 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting bb450a84140c415ab93ba022877f6c6c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 00:53:51,032 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 73fc6a273cb646a9af4708ea17984110, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 00:53:51,032 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 972f1169d36242f39287c1c213243666, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 00:53:51,032 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 3f14af22d5a24fa2a6fa8312d66b763b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 00:53:51,032 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting ebc8adf4cf974f4ea1768da8cb26137e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 00:53:51,032 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting a090af54325f4826acaf5e999f7df219, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 00:53:51,032 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 8431608d9d73458292f6151f44bbd643, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 00:53:51,032 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 03628c802d244d5a9c81c5b7ad3cad3a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 00:53:51,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 00:53:51,047 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:53:51,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122863a293d91fde4cd8b9881ddea9cbc017 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122863a293d91fde4cd8b9881ddea9cbc017 2023-03-11 00:53:51,054 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a73a0bc81b96456dad5d52db151c56e9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a73a0bc81b96456dad5d52db151c56e9 2023-03-11 00:53:51,056 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101c578ea71b5cc4fcab0bda7e93722c891 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101c578ea71b5cc4fcab0bda7e93722c891 2023-03-11 00:53:51,057 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601033a6c20387dec4e5eb55e4d260910ec71 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601033a6c20387dec4e5eb55e4d260910ec71 2023-03-11 00:53:51,058 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-11 00:53:51,058 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-11 00:53:51,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:51,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:51,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:51,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:51,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:51,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:51,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:51,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:51,090 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 36cfe1c0fa36465e8e4065cb6f4feb3e#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:53:51,916 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/e31567b8ba2a443ead7237771c8d36a7 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e31567b8ba2a443ead7237771c8d36a7 2023-03-11 00:53:51,930 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 of 36cfe1c0fa36465e8e4065cb6f4feb3e into e31567b8ba2a443ead7237771c8d36a7(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:53:51,930 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:51,932 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1678496031029; duration=0sec 2023-03-11 00:53:51,933 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:53:51,950 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052cf52a7a427e4996a9297a1b52d51d1c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052cf52a7a427e4996a9297a1b52d51d1c 2023-03-11 00:53:51,952 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 00:53:51,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/7dc32501e2ea4cdc860756c149236aa6, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bc8e7df9de8e41b8b040af4d4b237de9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bb450a84140c415ab93ba022877f6c6c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/73fc6a273cb646a9af4708ea17984110, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/972f1169d36242f39287c1c213243666, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/3f14af22d5a24fa2a6fa8312d66b763b, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/ebc8adf4cf974f4ea1768da8cb26137e, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/a090af54325f4826acaf5e999f7df219, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/8431608d9d73458292f6151f44bbd643, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/03628c802d244d5a9c81c5b7ad3cad3a_SeqId_44_] to archive 2023-03-11 00:53:51,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:53:51,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/7dc32501e2ea4cdc860756c149236aa6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/7dc32501e2ea4cdc860756c149236aa6 2023-03-11 00:53:51,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bc8e7df9de8e41b8b040af4d4b237de9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bc8e7df9de8e41b8b040af4d4b237de9 2023-03-11 00:53:51,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bb450a84140c415ab93ba022877f6c6c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/bb450a84140c415ab93ba022877f6c6c 2023-03-11 00:53:51,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/73fc6a273cb646a9af4708ea17984110 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/73fc6a273cb646a9af4708ea17984110 2023-03-11 00:53:51,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/972f1169d36242f39287c1c213243666 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/972f1169d36242f39287c1c213243666 2023-03-11 00:53:51,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/3f14af22d5a24fa2a6fa8312d66b763b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/3f14af22d5a24fa2a6fa8312d66b763b 2023-03-11 00:53:51,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/ebc8adf4cf974f4ea1768da8cb26137e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/ebc8adf4cf974f4ea1768da8cb26137e 2023-03-11 00:53:51,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/a090af54325f4826acaf5e999f7df219 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/a090af54325f4826acaf5e999f7df219 2023-03-11 00:53:51,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/8431608d9d73458292f6151f44bbd643 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/8431608d9d73458292f6151f44bbd643 2023-03-11 00:53:51,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/03628c802d244d5a9c81c5b7ad3cad3a_SeqId_44_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/03628c802d244d5a9c81c5b7ad3cad3a_SeqId_44_ 2023-03-11 00:53:51,997 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/19b96d160b194092ab3cbef5f08a8038 first=Optional[r00] last=Optional[r2] 2023-03-11 00:53:51,998 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/19b96d160b194092ab3cbef5f08a8038}] 2023-03-11 00:53:52,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/19b96d160b194092ab3cbef5f08a8038 for inclusion in 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 2023-03-11 00:53:52,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-11 00:53:52,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:53:52,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:52,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/19b96d160b194092ab3cbef5f08a8038 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dadeuc4gj94clphf5k6ngsgpt4prm83vmmu834l0rau1vmn11tiig5h2hp0dau91/family1/19b96d160b194092ab3cbef5f08a8038 2023-03-11 00:53:52,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dadeuc4gj94clphf5k6ngsgpt4prm83vmmu834l0rau1vmn11tiig5h2hp0dau91/family1/19b96d160b194092ab3cbef5f08a8038 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e68c4108fcab41929f4ee89ad05d1f6f_SeqId_47_ 2023-03-11 00:53:52,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dadeuc4gj94clphf5k6ngsgpt4prm83vmmu834l0rau1vmn11tiig5h2hp0dau91/family1/19b96d160b194092ab3cbef5f08a8038 into 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e68c4108fcab41929f4ee89ad05d1f6f_SeqId_47_ - updating store file list. 2023-03-11 00:53:52,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e68c4108fcab41929f4ee89ad05d1f6f_SeqId_47_ into 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 2023-03-11 00:53:52,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dadeuc4gj94clphf5k6ngsgpt4prm83vmmu834l0rau1vmn11tiig5h2hp0dau91/family1/19b96d160b194092ab3cbef5f08a8038 into 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e68c4108fcab41929f4ee89ad05d1f6f_SeqId_47_) 2023-03-11 00:53:52,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dadeuc4gj94clphf5k6ngsgpt4prm83vmmu834l0rau1vmn11tiig5h2hp0dau91/family1/19b96d160b194092ab3cbef5f08a8038 2023-03-11 00:53:52,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 00:53:52,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 00:53:52,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 is initiating minor compaction (all files) 2023-03-11 00:53:52,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3a5dc9af; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:53:52,021 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:52,021 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/15e345de2d2f4f9886c8e494b5a32b13, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e31567b8ba2a443ead7237771c8d36a7, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e68c4108fcab41929f4ee89ad05d1f6f_SeqId_47_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp, totalSize=358.6 K 2023-03-11 00:53:52,022 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 15e345de2d2f4f9886c8e494b5a32b13, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839224 2023-03-11 00:53:52,023 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting e31567b8ba2a443ead7237771c8d36a7, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239224 2023-03-11 00:53:52,024 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting e68c4108fcab41929f4ee89ad05d1f6f_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878839224 2023-03-11 00:53:52,024 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 00:53:52,025 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:53:52,028 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130cd905d3486a64bbab4e33ac4f2df776f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130cd905d3486a64bbab4e33ac4f2df776f 2023-03-11 00:53:52,030 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512018469e0f6e08347a4b905b6ce59aca1d4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512018469e0f6e08347a4b905b6ce59aca1d4 2023-03-11 00:53:52,032 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b416df7e2f98406f88c9f8e3713125d2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b416df7e2f98406f88c9f8e3713125d2 2023-03-11 00:53:52,032 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-11 00:53:52,032 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-11 00:53:52,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:52,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 00:53:52,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:53:52,035 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 00:53:52,037 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0330 sec 2023-03-11 00:53:52,073 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 36cfe1c0fa36465e8e4065cb6f4feb3e#family1#compaction#11 average throughput is 5.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:53:52,115 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/.tmp/family1/5a8d7fa9bfbf4866b6f4000519740a76 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/5a8d7fa9bfbf4866b6f4000519740a76 2023-03-11 00:53:52,125 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 of 36cfe1c0fa36465e8e4065cb6f4feb3e into 5a8d7fa9bfbf4866b6f4000519740a76(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:53:52,125 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:52,125 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1678496032020; duration=0sec 2023-03-11 00:53:52,125 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:53:52,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/15e345de2d2f4f9886c8e494b5a32b13, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e31567b8ba2a443ead7237771c8d36a7, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e68c4108fcab41929f4ee89ad05d1f6f_SeqId_47_] to archive 2023-03-11 00:53:52,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:53:52,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/15e345de2d2f4f9886c8e494b5a32b13 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/15e345de2d2f4f9886c8e494b5a32b13 2023-03-11 00:53:52,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e31567b8ba2a443ead7237771c8d36a7 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e31567b8ba2a443ead7237771c8d36a7 2023-03-11 00:53:52,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e68c4108fcab41929f4ee89ad05d1f6f_SeqId_47_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/e68c4108fcab41929f4ee89ad05d1f6f_SeqId_47_ 2023-03-11 00:53:52,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-11 00:53:52,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:52,272 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-11 00:53:52,274 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-11 00:53:52,274 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-11 00:53:52,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-11 00:53:52,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=36cfe1c0fa36465e8e4065cb6f4feb3e, REOPEN/MOVE}] 2023-03-11 00:53:52,294 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=36cfe1c0fa36465e8e4065cb6f4feb3e, REOPEN/MOVE 2023-03-11 00:53:52,295 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=36cfe1c0fa36465e8e4065cb6f4feb3e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:52,296 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678496032295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496032295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496032295"}]},"ts":"1678496032295"} 2023-03-11 00:53:52,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 36cfe1c0fa36465e8e4065cb6f4feb3e, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:53:52,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:52,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 36cfe1c0fa36465e8e4065cb6f4feb3e, disabling compactions & flushes 2023-03-11 00:53:52,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:52,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:52,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. after waiting 0 ms 2023-03-11 00:53:52,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:52,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-11 00:53:52,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:52,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:52,466 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 36cfe1c0fa36465e8e4065cb6f4feb3e to self. 2023-03-11 00:53:52,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:52,469 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=36cfe1c0fa36465e8e4065cb6f4feb3e, regionState=CLOSED 2023-03-11 00:53:52,469 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678496032469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496032469"}]},"ts":"1678496032469"} 2023-03-11 00:53:52,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-11 00:53:52,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 36cfe1c0fa36465e8e4065cb6f4feb3e, server=jenkins-hbase4.apache.org,38819,1678496016129 in 173 msec 2023-03-11 00:53:52,473 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=36cfe1c0fa36465e8e4065cb6f4feb3e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=true 2023-03-11 00:53:52,624 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=36cfe1c0fa36465e8e4065cb6f4feb3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:52,624 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678496032624"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496032624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496032624"}]},"ts":"1678496032624"} 2023-03-11 00:53:52,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 36cfe1c0fa36465e8e4065cb6f4feb3e, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:53:52,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:52,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 36cfe1c0fa36465e8e4065cb6f4feb3e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:53:52,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:52,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:52,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:52,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:52,784 INFO [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:52,785 DEBUG [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1 2023-03-11 00:53:52,786 DEBUG [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1 2023-03-11 00:53:52,786 INFO [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36cfe1c0fa36465e8e4065cb6f4feb3e columnFamilyName family1 2023-03-11 00:53:52,794 DEBUG [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/5a8d7fa9bfbf4866b6f4000519740a76 2023-03-11 00:53:52,794 INFO [StoreOpener-36cfe1c0fa36465e8e4065cb6f4feb3e-1] regionserver.HStore(310): Store=36cfe1c0fa36465e8e4065cb6f4feb3e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:52,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:52,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:52,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:53:52,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 36cfe1c0fa36465e8e4065cb6f4feb3e; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65165484, jitterRate=-0.028958618640899658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:53:52,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:52,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e., pid=17, masterSystemTime=1678496032779 2023-03-11 00:53:52,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:52,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:53:52,805 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=36cfe1c0fa36465e8e4065cb6f4feb3e, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:52,806 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678496032805"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496032805"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496032805"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496032805"}]},"ts":"1678496032805"} 2023-03-11 00:53:52,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-11 00:53:52,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 36cfe1c0fa36465e8e4065cb6f4feb3e, server=jenkins-hbase4.apache.org,38819,1678496016129 in 181 msec 2023-03-11 00:53:52,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-11 00:53:52,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=36cfe1c0fa36465e8e4065cb6f4feb3e, REOPEN/MOVE in 517 msec 2023-03-11 00:53:52,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-11 00:53:52,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 539 msec 2023-03-11 00:53:52,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 589 msec 2023-03-11 00:53:52,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-11 00:53:52,832 INFO [Listener at localhost/45619] compactions.TestMobCompactor(278): alter status finished 2023-03-11 00:53:52,833 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 00:53:52,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 00:53:52,835 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 00:53:52,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:53:52,837 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496632836 2023-03-11 00:53:52,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:53:52,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-11 00:53:52,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 00:53:52,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x0f7f09b7 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:53:52,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e61e8bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:53:52,880 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:52,880 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:52,880 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:52,880 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:52,880 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:53,715 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112877652a46b0b841ba8f1b6f54cc4d7d58 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112877652a46b0b841ba8f1b6f54cc4d7d58 2023-03-11 00:53:53,717 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 00:53:53,730 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:53:53,731 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53306, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:53:53,740 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:53:53,742 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51102, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:53:53,753 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1e1549945e824f3bbeda4932e5170395 first=Optional[r05] last=Optional[r8] 2023-03-11 00:53:53,753 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=51 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1e1549945e824f3bbeda4932e5170395}] 2023-03-11 00:53:53,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1e1549945e824f3bbeda4932e5170395 for inclusion in 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 2023-03-11 00:53:53,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-11 00:53:53,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:53:53,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:53:53,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1e1549945e824f3bbeda4932e5170395 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7a2dl15nd38s2qgit0o9bs0bdsrd01544gfqders18r92ndh1ktsluqq60r7kceq/family1/1e1549945e824f3bbeda4932e5170395 2023-03-11 00:53:53,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7a2dl15nd38s2qgit0o9bs0bdsrd01544gfqders18r92ndh1ktsluqq60r7kceq/family1/1e1549945e824f3bbeda4932e5170395 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/21bdf2203991450faccceaac415cddbc_SeqId_53_ 2023-03-11 00:53:53,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7a2dl15nd38s2qgit0o9bs0bdsrd01544gfqders18r92ndh1ktsluqq60r7kceq/family1/1e1549945e824f3bbeda4932e5170395 into 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/21bdf2203991450faccceaac415cddbc_SeqId_53_ - updating store file list. 2023-03-11 00:53:53,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/21bdf2203991450faccceaac415cddbc_SeqId_53_ into 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 2023-03-11 00:53:53,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7a2dl15nd38s2qgit0o9bs0bdsrd01544gfqders18r92ndh1ktsluqq60r7kceq/family1/1e1549945e824f3bbeda4932e5170395 into 36cfe1c0fa36465e8e4065cb6f4feb3e/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/family1/21bdf2203991450faccceaac415cddbc_SeqId_53_) 2023-03-11 00:53:53,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7a2dl15nd38s2qgit0o9bs0bdsrd01544gfqders18r92ndh1ktsluqq60r7kceq/family1/1e1549945e824f3bbeda4932e5170395 2023-03-11 00:53:53,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 00:53:53,778 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:53:53,780 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511204071bd36b6cd492f84a760d35083eb6c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511204071bd36b6cd492f84a760d35083eb6c 2023-03-11 00:53:53,781 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511289541beb91acf4984b19d411c7680a445 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511289541beb91acf4984b19d411c7680a445 2023-03-11 00:53:53,782 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-11 00:53:53,782 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-11 00:53:53,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:53,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:53,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 00:53:53,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 00:53:53,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:53:53,783 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 00:53:53,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 949 msec 2023-03-11 00:53:53,864 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=250 (was 211) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57824 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57794 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57984 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8c26de3-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57918 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57946 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:58018 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62412@0x0f7f09b7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/703039247.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8c26de3-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62412@0x0f7f09b7-SendThread(127.0.0.1:62412) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57892 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2423faae-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57872 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:58074 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62412@0x69fb9fc7-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57888 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2423faae-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8c26de3-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:58058 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8c26de3-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-706105258_15 at /127.0.0.1:58006 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62412@0x69fb9fc7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/703039247.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2423faae-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57848 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57962 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:38819-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62412@0x0f7f09b7-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57870 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62412@0x69fb9fc7-SendThread(127.0.0.1:62412) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:57900 [Waiting for operation #25] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x8c26de3-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=593 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 409), ProcessCount=170 (was 170), AvailableMemoryMB=5400 (was 5720) 2023-03-11 00:53:53,877 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=170, AvailableMemoryMB=5399 2023-03-11 00:53:53,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-11 00:53:53,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:53,883 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:53:53,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-11 00:53:53,884 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:53:53,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-11 00:53:53,885 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed 2023-03-11 00:53:53,886 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed empty. 2023-03-11 00:53:53,886 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed 2023-03-11 00:53:53,886 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-11 00:53:53,896 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-11 00:53:53,897 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 188d034f375c424808618086c37597ed, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:53:53,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-11 00:53:54,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-11 00:53:54,306 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:54,306 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 188d034f375c424808618086c37597ed, disabling compactions & flushes 2023-03-11 00:53:54,306 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:54,306 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:54,307 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. after waiting 0 ms 2023-03-11 00:53:54,307 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:54,307 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:54,307 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:53:54,310 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:53:54,311 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678496034310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496034310"}]},"ts":"1678496034310"} 2023-03-11 00:53:54,313 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 00:53:54,313 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:53:54,314 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496034314"}]},"ts":"1678496034314"} 2023-03-11 00:53:54,315 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-11 00:53:54,318 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=188d034f375c424808618086c37597ed, ASSIGN}] 2023-03-11 00:53:54,320 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=188d034f375c424808618086c37597ed, ASSIGN 2023-03-11 00:53:54,320 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=188d034f375c424808618086c37597ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:53:54,472 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=188d034f375c424808618086c37597ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:54,472 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678496034471"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496034471"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496034471"}]},"ts":"1678496034471"} 2023-03-11 00:53:54,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 188d034f375c424808618086c37597ed, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:53:54,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-11 00:53:54,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:54,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 188d034f375c424808618086c37597ed, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:53:54,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 188d034f375c424808618086c37597ed 2023-03-11 00:53:54,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:53:54,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 188d034f375c424808618086c37597ed 2023-03-11 00:53:54,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 188d034f375c424808618086c37597ed 2023-03-11 00:53:54,632 INFO [StoreOpener-188d034f375c424808618086c37597ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 188d034f375c424808618086c37597ed 2023-03-11 00:53:54,633 DEBUG [StoreOpener-188d034f375c424808618086c37597ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1 2023-03-11 00:53:54,633 DEBUG [StoreOpener-188d034f375c424808618086c37597ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1 2023-03-11 00:53:54,634 INFO [StoreOpener-188d034f375c424808618086c37597ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 188d034f375c424808618086c37597ed columnFamilyName family1 2023-03-11 00:53:54,636 INFO [StoreOpener-188d034f375c424808618086c37597ed-1] regionserver.HStore(310): Store=188d034f375c424808618086c37597ed/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:53:54,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed 2023-03-11 00:53:54,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed 2023-03-11 00:53:54,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 188d034f375c424808618086c37597ed 2023-03-11 00:53:54,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:53:54,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 188d034f375c424808618086c37597ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61695819, jitterRate=-0.08066065609455109}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:53:54,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:53:54,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed., pid=21, masterSystemTime=1678496034626 2023-03-11 00:53:54,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:54,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:54,646 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=188d034f375c424808618086c37597ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:54,646 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678496034646"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496034646"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496034646"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496034646"}]},"ts":"1678496034646"} 2023-03-11 00:53:54,651 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-11 00:53:54,651 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 188d034f375c424808618086c37597ed, server=jenkins-hbase4.apache.org,38819,1678496016129 in 174 msec 2023-03-11 00:53:54,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-11 00:53:54,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=188d034f375c424808618086c37597ed, ASSIGN in 333 msec 2023-03-11 00:53:54,654 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:53:54,654 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496034654"}]},"ts":"1678496034654"} 2023-03-11 00:53:54,655 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-11 00:53:54,658 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:53:54,660 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 778 msec 2023-03-11 00:53:54,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-11 00:53:54,989 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-11 00:53:55,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:55,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,028 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:55,028 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:55,029 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:53:55,029 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:53:55,029 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,030 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,032 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,032 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:55,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:55,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:55,032 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,032 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:55,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:55,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,033 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:53:55,034 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:55,034 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:53:55,034 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:55,034 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:55,034 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:55,034 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. started... 2023-03-11 00:53:55,035 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 188d034f375c424808618086c37597ed 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 00:53:55,409 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:55,461 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ac0f0f7396b443fd8e006fe725519bde to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ac0f0f7396b443fd8e006fe725519bde 2023-03-11 00:53:55,865 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/52e3f0ae701f4e3abeb79d5c0fee44b9 2023-03-11 00:53:55,871 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/52e3f0ae701f4e3abeb79d5c0fee44b9 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/52e3f0ae701f4e3abeb79d5c0fee44b9 2023-03-11 00:53:55,876 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/52e3f0ae701f4e3abeb79d5c0fee44b9, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-11 00:53:55,877 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 188d034f375c424808618086c37597ed in 842ms, sequenceid=5, compaction requested=false 2023-03-11 00:53:55,878 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:53:55,878 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:55,878 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:55,878 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:55,878 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,878 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:53:55,878 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:53:55,880 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,880 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:55,880 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,880 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:55,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:53:55,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d3312fd[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:55,882 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:53:55,882 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,884 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,884 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:53:55,884 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:53:55,884 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:55,884 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,885 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:53:55,886 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:55,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:55,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:55,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:55,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:53:55,889 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:53:55,889 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:55,889 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:55,889 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,889 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:55,890 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,890 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,890 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:55,891 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,892 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:55,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,894 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,894 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,894 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,894 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:55,895 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:55,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:55,895 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:55,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 00:53:55,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:55,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:55,895 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,895 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:55,895 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,896 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:55,896 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:55,896 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:55,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:55,996 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:55,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:56,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:56,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:56,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,004 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:56,004 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:56,005 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:53:56,005 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:53:56,005 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,005 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,008 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,008 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:56,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:56,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:56,008 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,008 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:56,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:56,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,009 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,009 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:53:56,009 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,009 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:53:56,009 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:56,010 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:53:56,010 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:56,010 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:56,010 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:56,010 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. started... 2023-03-11 00:53:56,010 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 188d034f375c424808618086c37597ed 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 00:53:56,425 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280e959eb4ed4c420f9640c4545421c013 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511280e959eb4ed4c420f9640c4545421c013 2023-03-11 00:53:56,832 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/5ed10697541b4476969507469d7b8f59 2023-03-11 00:53:56,838 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/5ed10697541b4476969507469d7b8f59 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/5ed10697541b4476969507469d7b8f59 2023-03-11 00:53:56,845 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/5ed10697541b4476969507469d7b8f59, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 00:53:56,846 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 188d034f375c424808618086c37597ed in 836ms, sequenceid=9, compaction requested=false 2023-03-11 00:53:56,846 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:53:56,846 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:56,846 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:56,846 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:56,846 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,846 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:53:56,846 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:53:56,848 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,848 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:56,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:56,848 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,848 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:56,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:56,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:56,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:56,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:53:56,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c88fea8[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:56,850 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:53:56,850 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,851 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,851 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:53:56,851 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:53:56,851 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,851 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:56,851 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:56,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:53:56,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:56,853 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:53:56,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:56,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:56,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:56,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:56,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:56,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:56,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:53:56,856 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:53:56,856 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:56,856 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:56,856 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,856 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:56,863 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,863 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:56,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,864 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:56,864 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,866 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:56,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,871 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,871 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,871 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,871 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,871 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,871 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,871 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:56,871 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:56,871 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:56,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:56,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:56,872 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:56,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:56,872 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:56,872 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:56,972 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:56,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:56,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:56,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:56,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,980 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:56,980 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:56,980 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:53:56,980 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:53:56,981 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,981 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,982 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,982 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:56,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:56,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:56,982 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:56,982 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:56,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,983 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,983 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:53:56,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:56,983 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:53:56,983 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:56,984 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:53:56,984 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:56,984 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:56,984 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:56,984 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. started... 2023-03-11 00:53:56,984 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 188d034f375c424808618086c37597ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:57,399 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b4166ffe812643f1a836a7452736c4ab to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201b4166ffe812643f1a836a7452736c4ab 2023-03-11 00:53:57,806 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/e3784e0f5d9147f1b9abb35589d4a5ff 2023-03-11 00:53:57,814 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/e3784e0f5d9147f1b9abb35589d4a5ff as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/e3784e0f5d9147f1b9abb35589d4a5ff 2023-03-11 00:53:57,821 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/e3784e0f5d9147f1b9abb35589d4a5ff, entries=1, sequenceid=13, filesize=4.9 K 2023-03-11 00:53:57,822 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 188d034f375c424808618086c37597ed in 838ms, sequenceid=13, compaction requested=true 2023-03-11 00:53:57,822 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:53:57,822 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:53:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:53:57,825 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:57,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:57,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:57,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:53:57,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c493eeb[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:57,827 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:53:57,827 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,828 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,828 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:53:57,828 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,829 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:57,828 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:53:57,829 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:57,830 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:53:57,830 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:57,830 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,830 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:53:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:57,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:53:57,833 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:53:57,833 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:57,833 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:57,833 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,833 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:57,835 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,835 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,835 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:57,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:57,836 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:57,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,838 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,842 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:57,842 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,842 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,842 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:57,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:57,842 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:57,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:57,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:57,842 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,843 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,843 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 00:53:57,843 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,843 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:57,843 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,843 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:57,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:57,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:57,944 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:57,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:57,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:57,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:57,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,951 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:57,951 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:57,952 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:53:57,952 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:53:57,952 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,953 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,954 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,954 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:57,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:57,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:57,954 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:57,954 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:57,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:57,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,955 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,955 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:53:57,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:57,955 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:53:57,956 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:57,956 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:53:57,956 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:57,956 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:57,956 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:57,956 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. started... 2023-03-11 00:53:57,957 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 188d034f375c424808618086c37597ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:57,975 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cff3e336b611458eb038ce4d939cbc19 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205cff3e336b611458eb038ce4d939cbc19 2023-03-11 00:53:57,997 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:53:58,387 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/a91a3165013e4958ba8460184b4dd1e4 2023-03-11 00:53:58,393 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/a91a3165013e4958ba8460184b4dd1e4 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/a91a3165013e4958ba8460184b4dd1e4 2023-03-11 00:53:58,398 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/a91a3165013e4958ba8460184b4dd1e4, entries=1, sequenceid=17, filesize=4.9 K 2023-03-11 00:53:58,399 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 188d034f375c424808618086c37597ed in 443ms, sequenceid=17, compaction requested=true 2023-03-11 00:53:58,399 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:53:58,399 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:58,399 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:58,399 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:58,399 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,399 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:53:58,399 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:53:58,418 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,418 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:58,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:58,418 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,418 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:58,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:58,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:58,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:58,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:53:58,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@544a95e4[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:58,420 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:53:58,420 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,471 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,472 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,472 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:53:58,472 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:58,472 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:53:58,472 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:58,496 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:53:58,496 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,496 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:58,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:58,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:58,496 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:53:58,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:58,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:58,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:58,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:58,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:53:58,500 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:53:58,500 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:58,500 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:58,500 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,500 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:58,518 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,518 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:58,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:58,518 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:58,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,518 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:58,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,519 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:58,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,564 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,564 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:58,564 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:58,564 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:58,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:58,564 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:58,564 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:58,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 00:53:58,564 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:58,565 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,565 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:58,565 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,565 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:58,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:58,565 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:58,665 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:58,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:58,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:58,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:58,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,673 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:58,673 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:58,674 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:53:58,674 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:53:58,674 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,674 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,725 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:58,725 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:58,726 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,726 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:58,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:58,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,727 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,727 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:53:58,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:58,727 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:53:58,727 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:53:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:58,728 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:58,728 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. started... 2023-03-11 00:53:58,728 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 188d034f375c424808618086c37597ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:59,144 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228baf947e57e364e57946c6140ef3feecc to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228baf947e57e364e57946c6140ef3feecc 2023-03-11 00:53:59,150 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/2211a8f5c6d04e7b836fd00854fba703 2023-03-11 00:53:59,157 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/2211a8f5c6d04e7b836fd00854fba703 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2211a8f5c6d04e7b836fd00854fba703 2023-03-11 00:53:59,163 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2211a8f5c6d04e7b836fd00854fba703, entries=1, sequenceid=21, filesize=4.9 K 2023-03-11 00:53:59,165 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 188d034f375c424808618086c37597ed in 437ms, sequenceid=21, compaction requested=true 2023-03-11 00:53:59,165 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:53:59,165 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:59,165 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:59,165 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:59,165 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,165 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:53:59,165 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:53:59,167 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,167 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:59,168 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,168 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:59,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:59,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:53:59,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@310bc16a[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:59,171 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:53:59,171 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,172 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:53:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:53:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:59,173 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,173 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:59,174 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:53:59,174 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,174 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:53:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:59,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:59,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:53:59,181 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:53:59,182 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:59,182 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:59,182 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,182 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:59,194 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,194 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:59,194 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:59,194 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:59,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,198 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:59,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,202 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:59,202 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:59,202 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,202 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:59,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:59,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:59,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:59,202 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,203 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,203 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,203 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,203 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,203 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:59,203 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:59,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:59,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:59,202 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:59,303 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:59,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:59,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:59,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:59,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,311 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:59,311 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:59,312 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:53:59,312 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:53:59,313 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,313 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,314 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,314 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:59,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:59,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:59,315 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,315 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:59,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,316 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:53:59,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,316 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:53:59,316 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:59,317 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:53:59,317 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:59,317 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:59,317 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. started... 2023-03-11 00:53:59,317 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:59,317 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 188d034f375c424808618086c37597ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:53:59,338 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d8da5dea33164819920adda2fc9e10e0 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d8da5dea33164819920adda2fc9e10e0 2023-03-11 00:53:59,752 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/f98bf890a9cf42379f9835101b546e78 2023-03-11 00:53:59,760 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/f98bf890a9cf42379f9835101b546e78 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/f98bf890a9cf42379f9835101b546e78 2023-03-11 00:53:59,766 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/f98bf890a9cf42379f9835101b546e78, entries=1, sequenceid=25, filesize=4.9 K 2023-03-11 00:53:59,767 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 188d034f375c424808618086c37597ed in 450ms, sequenceid=25, compaction requested=true 2023-03-11 00:53:59,767 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:53:59,767 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:59,767 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:53:59,767 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:53:59,767 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,767 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:53:59,767 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:53:59,769 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,769 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:59,770 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,770 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:53:59,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:59,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:59,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:59,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:53:59,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6aad145d[Count = 0] remaining members to acquire global barrier 2023-03-11 00:53:59,771 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:53:59,771 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,773 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,773 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:53:59,774 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:53:59,774 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:53:59,774 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,774 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:53:59,775 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:53:59,775 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,775 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:59,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:59,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:59,775 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:53:59,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:59,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:53:59,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:53:59,778 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:53:59,778 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:53:59,778 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:53:59,778 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,778 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:53:59,780 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,780 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,780 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:59,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:53:59,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:53:59,781 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:59,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:59,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:53:59,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:53:59,782 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:53:59,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,784 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,784 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:59,784 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:59,784 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:53:59,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:59,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:53:59,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:59,784 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,784 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:53:59,785 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,785 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,785 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,785 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,785 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:53:59,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:53:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:53:59,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 00:53:59,785 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:53:59,886 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:53:59,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:53:59,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:53:59,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:53:59,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,893 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:53:59,893 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:59,894 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:53:59,894 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:53:59,895 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,895 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,897 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,897 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:53:59,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:53:59,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:53:59,898 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:53:59,898 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:53:59,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:53:59,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,899 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,899 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:53:59,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:53:59,900 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:53:59,900 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:53:59,900 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:53:59,900 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:53:59,900 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:53:59,901 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:53:59,901 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. started... 2023-03-11 00:53:59,901 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 188d034f375c424808618086c37597ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:00,325 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017a0f96f35e2c41febd9c878707d6d4de to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601017a0f96f35e2c41febd9c878707d6d4de 2023-03-11 00:54:00,731 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/37c8cc0821db4993a1341b950f9fbdd7 2023-03-11 00:54:00,737 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/37c8cc0821db4993a1341b950f9fbdd7 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/37c8cc0821db4993a1341b950f9fbdd7 2023-03-11 00:54:00,742 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/37c8cc0821db4993a1341b950f9fbdd7, entries=1, sequenceid=29, filesize=4.9 K 2023-03-11 00:54:00,743 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 188d034f375c424808618086c37597ed in 842ms, sequenceid=29, compaction requested=true 2023-03-11 00:54:00,743 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:54:00,743 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:54:00,743 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:00,743 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:00,743 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,743 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:54:00,743 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:54:00,745 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:00,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:00,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:54:00,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ff6c185[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:00,746 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:00,746 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,747 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,747 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:00,747 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:54:00,747 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:00,747 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,748 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:00,749 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,749 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:54:00,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,749 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:00,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:00,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:00,749 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:54:00,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:00,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:00,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:00,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:00,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:00,751 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:54:00,752 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:00,752 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:00,752 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,752 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:00,755 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,755 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:00,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:00,755 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:00,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:00,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:00,755 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:00,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:00,756 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:00,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,758 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,758 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,758 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,758 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,758 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,758 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,758 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:00,758 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:54:00,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:00,758 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:00,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 00:54:00,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:00,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:00,759 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:00,759 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:00,760 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:00,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:00,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:00,860 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:00,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:00,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:00,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:00,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,868 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:54:00,868 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:00,868 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:54:00,868 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:00,869 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,869 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:00,870 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:00,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:00,870 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:00,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,870 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:00,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,871 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,871 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:54:00,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:00,871 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:54:00,872 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:00,872 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:54:00,872 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:00,872 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:00,872 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:54:00,872 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. started... 2023-03-11 00:54:00,872 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 188d034f375c424808618086c37597ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:01,288 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a3f57780103a459a8b37222d147e00b3 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a3f57780103a459a8b37222d147e00b3 2023-03-11 00:54:01,694 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/401eb62a9836453c99e0519bac759dbd 2023-03-11 00:54:01,701 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/401eb62a9836453c99e0519bac759dbd as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/401eb62a9836453c99e0519bac759dbd 2023-03-11 00:54:01,706 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/401eb62a9836453c99e0519bac759dbd, entries=1, sequenceid=33, filesize=4.9 K 2023-03-11 00:54:01,707 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 188d034f375c424808618086c37597ed in 835ms, sequenceid=33, compaction requested=true 2023-03-11 00:54:01,707 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:54:01,707 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:54:01,707 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:01,707 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:01,707 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,707 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:54:01,707 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:54:01,709 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,709 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:01,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:01,709 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,709 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:01,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:01,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:54:01,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f13802a[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:01,710 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:01,711 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,715 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,715 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:01,715 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:54:01,715 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:01,715 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,715 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:01,719 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:54:01,719 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,719 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:01,719 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:01,721 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:54:01,721 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:01,721 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:01,721 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,721 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:01,723 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,723 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:01,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,723 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:01,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:01,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:01,723 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:01,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:01,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:01,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,725 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:01,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,727 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,727 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,727 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:01,727 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:01,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:54:01,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:01,727 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,727 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:01,727 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:01,728 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:01,728 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,728 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:01,728 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,728 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:01,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:01,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:01,829 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:01,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:01,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:01,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:01,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,837 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:54:01,837 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:01,837 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:54:01,837 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:01,838 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,838 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,839 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,839 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:01,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:01,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:01,839 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:01,840 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:01,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:01,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,840 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,841 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:54:01,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:01,841 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:54:01,841 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:01,841 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:54:01,841 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:01,841 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:01,841 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:54:01,841 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. started... 2023-03-11 00:54:01,841 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 188d034f375c424808618086c37597ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:02,256 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b3d90f78df7c4bd0bde6e435211dac96 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907b3d90f78df7c4bd0bde6e435211dac96 2023-03-11 00:54:02,662 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/c1b977ce32244cab8c4b2d43b29b9b74 2023-03-11 00:54:02,668 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/c1b977ce32244cab8c4b2d43b29b9b74 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/c1b977ce32244cab8c4b2d43b29b9b74 2023-03-11 00:54:02,673 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/c1b977ce32244cab8c4b2d43b29b9b74, entries=1, sequenceid=37, filesize=4.9 K 2023-03-11 00:54:02,674 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 188d034f375c424808618086c37597ed in 833ms, sequenceid=37, compaction requested=true 2023-03-11 00:54:02,674 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:54:02,674 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:54:02,674 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:02,674 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:02,674 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,675 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:54:02,675 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:54:02,676 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,676 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:02,676 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,676 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:02,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:54:02,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60fc0033[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:02,678 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:02,678 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,679 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,679 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:02,679 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:54:02,679 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:02,679 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,679 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:02,682 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:54:02,682 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:02,682 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,682 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:54:02,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:02,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:02,685 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:54:02,685 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:02,685 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:02,685 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,685 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:02,687 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,687 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,687 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:02,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:02,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:02,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:02,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:02,688 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:02,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:02,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,689 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,691 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,691 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,691 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:02,691 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:02,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:02,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:02,691 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:02,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:54:02,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:02,691 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,692 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,692 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:02,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:02,692 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,692 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:02,692 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:02,692 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,792 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:02,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:02,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:02,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:02,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,800 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:54:02,800 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:02,801 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:54:02,801 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:02,801 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,801 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,802 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:02,802 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:02,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:02,803 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:02,803 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:02,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:02,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,804 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,804 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:54:02,804 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:02,804 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:54:02,804 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:02,805 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:54:02,805 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:02,805 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:02,806 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:54:02,806 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. started... 2023-03-11 00:54:02,806 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 188d034f375c424808618086c37597ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:03,221 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202bb7a82dd2b840d095a4e6ef0df07dba to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202bb7a82dd2b840d095a4e6ef0df07dba 2023-03-11 00:54:03,626 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/1decc98dc86a4befb9adf6a21d7cbf07 2023-03-11 00:54:03,632 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/1decc98dc86a4befb9adf6a21d7cbf07 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/1decc98dc86a4befb9adf6a21d7cbf07 2023-03-11 00:54:03,637 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/1decc98dc86a4befb9adf6a21d7cbf07, entries=1, sequenceid=41, filesize=4.9 K 2023-03-11 00:54:03,638 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 188d034f375c424808618086c37597ed in 832ms, sequenceid=41, compaction requested=true 2023-03-11 00:54:03,638 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:54:03,638 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:54:03,638 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:03,638 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:03,638 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,638 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:54:03,638 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:54:03,641 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,641 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:03,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:03,641 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,641 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:03,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62f1ff8d[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:03,642 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:03,643 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,644 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,644 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:03,644 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:54:03,644 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:03,644 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,644 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:03,645 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,645 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:54:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:03,645 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:03,646 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:54:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:03,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:03,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:03,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:03,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:03,648 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:54:03,648 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:03,648 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:03,648 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,648 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:03,650 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,650 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,650 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:03,650 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,651 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,654 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,654 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,654 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:03,654 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:03,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:03,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:03,654 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:03,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 00:54:03,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:03,654 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,656 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:03,656 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:03,656 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:03,656 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,656 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:03,656 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:03,756 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:03,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:03,758 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-11 00:54:03,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:54:03,761 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:54:03,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:03,762 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496643761 2023-03-11 00:54:03,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:54:03,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-11 00:54:03,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:54:03,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x0973083e to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:54:03,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78a635a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:54:03,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:54:04,605 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037276c35e720c4e2baca8ebaaef44b359 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601037276c35e720c4e2baca8ebaaef44b359 2023-03-11 00:54:04,606 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:54:04,618 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:54:04,619 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43124, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:54:04,626 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:54:04,627 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39534, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:54:04,636 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b1ebca17b8a74310a4126055d5a7512c first=Optional[r5] last=Optional[r6] 2023-03-11 00:54:04,637 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b1ebca17b8a74310a4126055d5a7512c}] 2023-03-11 00:54:04,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b1ebca17b8a74310a4126055d5a7512c for inclusion in 188d034f375c424808618086c37597ed/family1 2023-03-11 00:54:04,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-11 00:54:04,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:54:04,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:54:04,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b1ebca17b8a74310a4126055d5a7512c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g5danug9c8barrblmskmg2k2qhnnvdvianq0d8tgdsu4ks4kd35mnfbe3uo5d534/family1/b1ebca17b8a74310a4126055d5a7512c 2023-03-11 00:54:04,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g5danug9c8barrblmskmg2k2qhnnvdvianq0d8tgdsu4ks4kd35mnfbe3uo5d534/family1/b1ebca17b8a74310a4126055d5a7512c as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/53f444e396e741109e6e905c7a894a7c_SeqId_44_ 2023-03-11 00:54:04,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g5danug9c8barrblmskmg2k2qhnnvdvianq0d8tgdsu4ks4kd35mnfbe3uo5d534/family1/b1ebca17b8a74310a4126055d5a7512c into 188d034f375c424808618086c37597ed/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/53f444e396e741109e6e905c7a894a7c_SeqId_44_ - updating store file list. 2023-03-11 00:54:04,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/53f444e396e741109e6e905c7a894a7c_SeqId_44_ into 188d034f375c424808618086c37597ed/family1 2023-03-11 00:54:04,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g5danug9c8barrblmskmg2k2qhnnvdvianq0d8tgdsu4ks4kd35mnfbe3uo5d534/family1/b1ebca17b8a74310a4126055d5a7512c into 188d034f375c424808618086c37597ed/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/53f444e396e741109e6e905c7a894a7c_SeqId_44_) 2023-03-11 00:54:04,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g5danug9c8barrblmskmg2k2qhnnvdvianq0d8tgdsu4ks4kd35mnfbe3uo5d534/family1/b1ebca17b8a74310a4126055d5a7512c 2023-03-11 00:54:04,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 00:54:04,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 00:54:04,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 188d034f375c424808618086c37597ed/family1 is initiating minor compaction 2023-03-11 00:54:04,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5c4fda76; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:04,658 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 188d034f375c424808618086c37597ed/family1 in testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:54:04,658 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/5ed10697541b4476969507469d7b8f59, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/e3784e0f5d9147f1b9abb35589d4a5ff, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/a91a3165013e4958ba8460184b4dd1e4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2211a8f5c6d04e7b836fd00854fba703, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/f98bf890a9cf42379f9835101b546e78, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/37c8cc0821db4993a1341b950f9fbdd7, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/401eb62a9836453c99e0519bac759dbd, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/c1b977ce32244cab8c4b2d43b29b9b74, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/1decc98dc86a4befb9adf6a21d7cbf07, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/53f444e396e741109e6e905c7a894a7c_SeqId_44_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp, totalSize=49.7 K 2023-03-11 00:54:04,659 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 5ed10697541b4476969507469d7b8f59, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 00:54:04,659 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting e3784e0f5d9147f1b9abb35589d4a5ff, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 00:54:04,659 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting a91a3165013e4958ba8460184b4dd1e4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 00:54:04,659 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 2211a8f5c6d04e7b836fd00854fba703, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 00:54:04,659 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting f98bf890a9cf42379f9835101b546e78, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 00:54:04,659 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 37c8cc0821db4993a1341b950f9fbdd7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 00:54:04,659 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 401eb62a9836453c99e0519bac759dbd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 00:54:04,659 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting c1b977ce32244cab8c4b2d43b29b9b74, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 00:54:04,659 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 1decc98dc86a4befb9adf6a21d7cbf07, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 00:54:04,659 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 53f444e396e741109e6e905c7a894a7c_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 00:54:04,660 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:54:04,661 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:04,663 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601017a0f96f35e2c41febd9c878707d6d4de to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601017a0f96f35e2c41febd9c878707d6d4de 2023-03-11 00:54:04,665 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a3f57780103a459a8b37222d147e00b3 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a3f57780103a459a8b37222d147e00b3 2023-03-11 00:54:04,665 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-11 00:54:04,665 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-11 00:54:04,665 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:54:04,665 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:54:04,699 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 188d034f375c424808618086c37597ed#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:54:05,522 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/16b867a7d40e4a65a6d057e9696da330 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/16b867a7d40e4a65a6d057e9696da330 2023-03-11 00:54:05,528 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f0492151f8204bde94af8b24f6e1d96c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231f0492151f8204bde94af8b24f6e1d96c 2023-03-11 00:54:05,529 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 188d034f375c424808618086c37597ed/family1 of 188d034f375c424808618086c37597ed into 16b867a7d40e4a65a6d057e9696da330(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:54:05,529 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:54:05,529 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:54:05,529 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678496044658; duration=0sec 2023-03-11 00:54:05,529 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:05,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/5ed10697541b4476969507469d7b8f59, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/e3784e0f5d9147f1b9abb35589d4a5ff, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/a91a3165013e4958ba8460184b4dd1e4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2211a8f5c6d04e7b836fd00854fba703, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/f98bf890a9cf42379f9835101b546e78, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/37c8cc0821db4993a1341b950f9fbdd7, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/401eb62a9836453c99e0519bac759dbd, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/c1b977ce32244cab8c4b2d43b29b9b74, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/1decc98dc86a4befb9adf6a21d7cbf07, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/53f444e396e741109e6e905c7a894a7c_SeqId_44_] to archive 2023-03-11 00:54:05,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:05,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/5ed10697541b4476969507469d7b8f59 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/5ed10697541b4476969507469d7b8f59 2023-03-11 00:54:05,564 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8d18d97df75c43d69a6aa1c29fa7b9ca first=Optional[r1] last=Optional[r4] 2023-03-11 00:54:05,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/e3784e0f5d9147f1b9abb35589d4a5ff to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/e3784e0f5d9147f1b9abb35589d4a5ff 2023-03-11 00:54:05,564 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8d18d97df75c43d69a6aa1c29fa7b9ca}] 2023-03-11 00:54:05,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/a91a3165013e4958ba8460184b4dd1e4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/a91a3165013e4958ba8460184b4dd1e4 2023-03-11 00:54:05,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8d18d97df75c43d69a6aa1c29fa7b9ca for inclusion in 188d034f375c424808618086c37597ed/family1 2023-03-11 00:54:05,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2211a8f5c6d04e7b836fd00854fba703 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2211a8f5c6d04e7b836fd00854fba703 2023-03-11 00:54:05,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/f98bf890a9cf42379f9835101b546e78 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/f98bf890a9cf42379f9835101b546e78 2023-03-11 00:54:05,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/37c8cc0821db4993a1341b950f9fbdd7 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/37c8cc0821db4993a1341b950f9fbdd7 2023-03-11 00:54:05,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-11 00:54:05,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:54:05,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:54:05,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8d18d97df75c43d69a6aa1c29fa7b9ca to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__apraqq63us8d41nd2rkfqssuq8r5ruj01jb1b78sogtn89pk0ud0mn9f75psupn0/family1/8d18d97df75c43d69a6aa1c29fa7b9ca 2023-03-11 00:54:05,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/401eb62a9836453c99e0519bac759dbd to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/401eb62a9836453c99e0519bac759dbd 2023-03-11 00:54:05,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/c1b977ce32244cab8c4b2d43b29b9b74 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/c1b977ce32244cab8c4b2d43b29b9b74 2023-03-11 00:54:05,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__apraqq63us8d41nd2rkfqssuq8r5ruj01jb1b78sogtn89pk0ud0mn9f75psupn0/family1/8d18d97df75c43d69a6aa1c29fa7b9ca as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2d8ec8ac808d46f3abc6f427d58327bf_SeqId_47_ 2023-03-11 00:54:05,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__apraqq63us8d41nd2rkfqssuq8r5ruj01jb1b78sogtn89pk0ud0mn9f75psupn0/family1/8d18d97df75c43d69a6aa1c29fa7b9ca into 188d034f375c424808618086c37597ed/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2d8ec8ac808d46f3abc6f427d58327bf_SeqId_47_ - updating store file list. 2023-03-11 00:54:05,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/1decc98dc86a4befb9adf6a21d7cbf07 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/1decc98dc86a4befb9adf6a21d7cbf07 2023-03-11 00:54:05,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/53f444e396e741109e6e905c7a894a7c_SeqId_44_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/53f444e396e741109e6e905c7a894a7c_SeqId_44_ 2023-03-11 00:54:05,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2d8ec8ac808d46f3abc6f427d58327bf_SeqId_47_ into 188d034f375c424808618086c37597ed/family1 2023-03-11 00:54:05,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__apraqq63us8d41nd2rkfqssuq8r5ruj01jb1b78sogtn89pk0ud0mn9f75psupn0/family1/8d18d97df75c43d69a6aa1c29fa7b9ca into 188d034f375c424808618086c37597ed/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2d8ec8ac808d46f3abc6f427d58327bf_SeqId_47_) 2023-03-11 00:54:05,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__apraqq63us8d41nd2rkfqssuq8r5ruj01jb1b78sogtn89pk0ud0mn9f75psupn0/family1/8d18d97df75c43d69a6aa1c29fa7b9ca 2023-03-11 00:54:05,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 00:54:05,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 00:54:05,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 188d034f375c424808618086c37597ed/family1 is initiating minor compaction (all files) 2023-03-11 00:54:05,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@280597b6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:05,582 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 188d034f375c424808618086c37597ed/family1 in testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:54:05,582 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/52e3f0ae701f4e3abeb79d5c0fee44b9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/16b867a7d40e4a65a6d057e9696da330, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2d8ec8ac808d46f3abc6f427d58327bf_SeqId_47_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp, totalSize=178.1 K 2023-03-11 00:54:05,582 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 52e3f0ae701f4e3abeb79d5c0fee44b9, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839224 2023-03-11 00:54:05,583 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 16b867a7d40e4a65a6d057e9696da330, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239224 2023-03-11 00:54:05,583 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 2d8ec8ac808d46f3abc6f427d58327bf_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965239224 2023-03-11 00:54:05,584 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:54:05,585 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:05,587 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201b4166ffe812643f1a836a7452736c4ab to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201b4166ffe812643f1a836a7452736c4ab 2023-03-11 00:54:05,589 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205cff3e336b611458eb038ce4d939cbc19 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205cff3e336b611458eb038ce4d939cbc19 2023-03-11 00:54:05,590 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228baf947e57e364e57946c6140ef3feecc to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228baf947e57e364e57946c6140ef3feecc 2023-03-11 00:54:05,591 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d8da5dea33164819920adda2fc9e10e0 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d8da5dea33164819920adda2fc9e10e0 2023-03-11 00:54:05,591 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-11 00:54:05,591 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-11 00:54:05,592 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:54:05,592 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:54:05,604 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 188d034f375c424808618086c37597ed#family1#compaction#23 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:54:06,437 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/.tmp/family1/8c47ad0bbee640f189d740613a57a231 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/8c47ad0bbee640f189d740613a57a231 2023-03-11 00:54:06,443 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 188d034f375c424808618086c37597ed/family1 of 188d034f375c424808618086c37597ed into 8c47ad0bbee640f189d740613a57a231(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:54:06,443 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:54:06,443 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1678496045581; duration=0sec 2023-03-11 00:54:06,443 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:06,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/52e3f0ae701f4e3abeb79d5c0fee44b9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/16b867a7d40e4a65a6d057e9696da330, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2d8ec8ac808d46f3abc6f427d58327bf_SeqId_47_] to archive 2023-03-11 00:54:06,449 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:06,451 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300d0c6505a1a74ecaaf2559a57d39fc99 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300d0c6505a1a74ecaaf2559a57d39fc99 2023-03-11 00:54:06,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/52e3f0ae701f4e3abeb79d5c0fee44b9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/52e3f0ae701f4e3abeb79d5c0fee44b9 2023-03-11 00:54:06,452 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:54:06,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/16b867a7d40e4a65a6d057e9696da330 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/16b867a7d40e4a65a6d057e9696da330 2023-03-11 00:54:06,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2d8ec8ac808d46f3abc6f427d58327bf_SeqId_47_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/2d8ec8ac808d46f3abc6f427d58327bf_SeqId_47_ 2023-03-11 00:54:06,476 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e649bd789ecd4ce194f33ec434250171 first=Optional[r00] last=Optional[r8] 2023-03-11 00:54:06,477 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e649bd789ecd4ce194f33ec434250171}] 2023-03-11 00:54:06,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e649bd789ecd4ce194f33ec434250171 for inclusion in 188d034f375c424808618086c37597ed/family1 2023-03-11 00:54:06,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-11 00:54:06,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:54:06,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:54:06,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e649bd789ecd4ce194f33ec434250171 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rbjom84j06o1r2bko5nmo5erpk1gjduo6d9m59c5idjm23euj5odpe5jq7r69h09/family1/e649bd789ecd4ce194f33ec434250171 2023-03-11 00:54:06,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rbjom84j06o1r2bko5nmo5erpk1gjduo6d9m59c5idjm23euj5odpe5jq7r69h09/family1/e649bd789ecd4ce194f33ec434250171 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/21ef0b058b62468a8ab8726410860703_SeqId_50_ 2023-03-11 00:54:06,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rbjom84j06o1r2bko5nmo5erpk1gjduo6d9m59c5idjm23euj5odpe5jq7r69h09/family1/e649bd789ecd4ce194f33ec434250171 into 188d034f375c424808618086c37597ed/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/21ef0b058b62468a8ab8726410860703_SeqId_50_ - updating store file list. 2023-03-11 00:54:06,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/21ef0b058b62468a8ab8726410860703_SeqId_50_ into 188d034f375c424808618086c37597ed/family1 2023-03-11 00:54:06,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rbjom84j06o1r2bko5nmo5erpk1gjduo6d9m59c5idjm23euj5odpe5jq7r69h09/family1/e649bd789ecd4ce194f33ec434250171 into 188d034f375c424808618086c37597ed/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/family1/21ef0b058b62468a8ab8726410860703_SeqId_50_) 2023-03-11 00:54:06,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rbjom84j06o1r2bko5nmo5erpk1gjduo6d9m59c5idjm23euj5odpe5jq7r69h09/family1/e649bd789ecd4ce194f33ec434250171 2023-03-11 00:54:06,491 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:54:06,492 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:06,493 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202bb7a82dd2b840d095a4e6ef0df07dba to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202bb7a82dd2b840d095a4e6ef0df07dba 2023-03-11 00:54:06,494 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511280e959eb4ed4c420f9640c4545421c013 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511280e959eb4ed4c420f9640c4545421c013 2023-03-11 00:54:06,495 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ac0f0f7396b443fd8e006fe725519bde to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ac0f0f7396b443fd8e006fe725519bde 2023-03-11 00:54:06,495 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-11 00:54:06,495 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-11 00:54:06,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:54:06,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:54:06,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:54:06,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:54:06,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:06,497 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:54:06,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7380 sec 2023-03-11 00:54:06,602 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=254 (was 250) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56678 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-706105258_15 at /127.0.0.1:56664 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56698 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56722 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x436b4694-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56746 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56754 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x436b4694-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56766 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56796 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-706105258_15 at /127.0.0.1:58018 [Waiting for operation #29] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56648 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x436b4694-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62412@0x0973083e-SendThread(127.0.0.1:62412) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x436b4694-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62412@0x0973083e sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/703039247.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56712 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/cluster_222610a7-004e-a65d-0f45-8973b54f643a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:39428 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x436b4694-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56708 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x436b4694-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62412@0x0973083e-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:58006 [Waiting for operation #28] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/cluster_222610a7-004e-a65d-0f45-8973b54f643a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x436b4694-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56806 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702005027_15 at /127.0.0.1:56848 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=607 (was 593) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=269 (was 346), ProcessCount=170 (was 170), AvailableMemoryMB=6076 (was 5399) - AvailableMemoryMB LEAK? - 2023-03-11 00:54:06,614 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=254, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=269, ProcessCount=170, AvailableMemoryMB=6075 2023-03-11 00:54:06,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 00:54:06,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:06,620 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:54:06,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-11 00:54:06,620 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:54:06,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 00:54:06,622 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511 2023-03-11 00:54:06,622 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511 empty. 2023-03-11 00:54:06,623 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511 2023-03-11 00:54:06,623 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-11 00:54:06,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 00:54:06,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 00:54:07,033 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-11 00:54:07,034 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2dd70ffc836295255740f79f024e3511, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:54:07,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 00:54:07,441 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:07,441 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 2dd70ffc836295255740f79f024e3511, disabling compactions & flushes 2023-03-11 00:54:07,441 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:07,441 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:07,441 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. after waiting 0 ms 2023-03-11 00:54:07,441 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:07,441 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:07,441 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:07,444 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:54:07,445 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678496047444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496047444"}]},"ts":"1678496047444"} 2023-03-11 00:54:07,446 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 00:54:07,447 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:54:07,448 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496047447"}]},"ts":"1678496047447"} 2023-03-11 00:54:07,449 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-11 00:54:07,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=2dd70ffc836295255740f79f024e3511, ASSIGN}] 2023-03-11 00:54:07,457 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=2dd70ffc836295255740f79f024e3511, ASSIGN 2023-03-11 00:54:07,458 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=2dd70ffc836295255740f79f024e3511, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:54:07,609 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=2dd70ffc836295255740f79f024e3511, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:07,609 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678496047609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496047609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496047609"}]},"ts":"1678496047609"} 2023-03-11 00:54:07,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 2dd70ffc836295255740f79f024e3511, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:07,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 00:54:07,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:07,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2dd70ffc836295255740f79f024e3511, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:54:07,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 2dd70ffc836295255740f79f024e3511 2023-03-11 00:54:07,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:07,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2dd70ffc836295255740f79f024e3511 2023-03-11 00:54:07,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2dd70ffc836295255740f79f024e3511 2023-03-11 00:54:07,768 INFO [StoreOpener-2dd70ffc836295255740f79f024e3511-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2dd70ffc836295255740f79f024e3511 2023-03-11 00:54:07,770 DEBUG [StoreOpener-2dd70ffc836295255740f79f024e3511-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1 2023-03-11 00:54:07,770 DEBUG [StoreOpener-2dd70ffc836295255740f79f024e3511-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1 2023-03-11 00:54:07,770 INFO [StoreOpener-2dd70ffc836295255740f79f024e3511-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2dd70ffc836295255740f79f024e3511 columnFamilyName family1 2023-03-11 00:54:07,772 INFO [StoreOpener-2dd70ffc836295255740f79f024e3511-1] regionserver.HStore(310): Store=2dd70ffc836295255740f79f024e3511/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:07,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511 2023-03-11 00:54:07,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511 2023-03-11 00:54:07,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2dd70ffc836295255740f79f024e3511 2023-03-11 00:54:07,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:54:07,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2dd70ffc836295255740f79f024e3511; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63576833, jitterRate=-0.05263136327266693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:54:07,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:07,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511., pid=25, masterSystemTime=1678496047763 2023-03-11 00:54:07,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:07,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:07,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=2dd70ffc836295255740f79f024e3511, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:07,781 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678496047781"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496047781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496047781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496047781"}]},"ts":"1678496047781"} 2023-03-11 00:54:07,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-11 00:54:07,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 2dd70ffc836295255740f79f024e3511, server=jenkins-hbase4.apache.org,38819,1678496016129 in 171 msec 2023-03-11 00:54:07,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-11 00:54:07,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=2dd70ffc836295255740f79f024e3511, ASSIGN in 328 msec 2023-03-11 00:54:07,786 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:54:07,787 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496047787"}]},"ts":"1678496047787"} 2023-03-11 00:54:07,788 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-11 00:54:07,790 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:54:07,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1730 sec 2023-03-11 00:54:08,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 00:54:08,727 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-11 00:54:08,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:08,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:08,750 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:08,750 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:08,750 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:08,750 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:08,750 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:08,750 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:08,752 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:08,752 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:08,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:08,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:08,753 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:08,753 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:08,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:08,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:08,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:08,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:08,753 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:08,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:08,754 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:08,754 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:08,754 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:08,756 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:08,756 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:08,756 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:08,756 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. started... 2023-03-11 00:54:08,757 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2dd70ffc836295255740f79f024e3511 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 00:54:09,183 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301faeeaddec674252ba0a42bdfac7ad9b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511301faeeaddec674252ba0a42bdfac7ad9b 2023-03-11 00:54:09,587 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/985bbe4ef1ca4cfc8f38bf107f553cc8 2023-03-11 00:54:09,594 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/985bbe4ef1ca4cfc8f38bf107f553cc8 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/985bbe4ef1ca4cfc8f38bf107f553cc8 2023-03-11 00:54:09,598 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/985bbe4ef1ca4cfc8f38bf107f553cc8, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-11 00:54:09,599 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 2dd70ffc836295255740f79f024e3511 in 843ms, sequenceid=5, compaction requested=false 2023-03-11 00:54:09,599 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:09,600 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:09,600 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:09,600 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:09,600 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:09,600 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,601 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:09,601 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:09,602 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,602 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:09,603 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,603 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:09,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:09,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b32e0bf[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:09,604 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:09,604 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,605 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,606 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:09,606 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,606 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:09,606 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:09,606 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:09,607 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,607 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:09,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:09,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:09,607 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:09,607 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:09,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:09,609 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:09,609 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:09,609 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:09,610 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,610 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:09,612 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,612 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:09,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,612 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:09,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:09,612 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:09,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,613 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:09,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,615 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,615 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,615 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:09,616 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:09,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:09,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:09,616 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,616 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:09,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:09,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:09,616 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:09,616 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:09,616 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:09,616 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:09,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:09,616 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,616 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,716 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:09,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:09,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,724 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:09,724 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:09,724 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:09,724 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:09,725 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,725 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,726 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,726 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:09,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:09,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:09,726 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:09,726 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:09,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:09,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,727 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,728 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:09,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:09,728 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:09,728 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:09,728 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:09,728 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:09,728 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:09,728 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:09,728 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. started... 2023-03-11 00:54:09,728 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2dd70ffc836295255740f79f024e3511 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 00:54:10,141 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112834cd580f5f334a8ca4069b0ddc45d3b2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112834cd580f5f334a8ca4069b0ddc45d3b2 2023-03-11 00:54:10,547 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/c67e294b1ecb41a09f0981aedeaeac6a 2023-03-11 00:54:10,552 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/c67e294b1ecb41a09f0981aedeaeac6a as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/c67e294b1ecb41a09f0981aedeaeac6a 2023-03-11 00:54:10,556 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/c67e294b1ecb41a09f0981aedeaeac6a, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 00:54:10,557 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 2dd70ffc836295255740f79f024e3511 in 829ms, sequenceid=9, compaction requested=false 2023-03-11 00:54:10,558 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:10,558 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:10,558 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:10,558 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:10,558 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,558 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:10,558 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:10,560 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,560 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:10,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:10,560 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,560 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:10,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:10,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:10,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:10,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:10,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48332923[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:10,561 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:10,561 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,563 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,563 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,563 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:10,563 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:10,563 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:10,563 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:10,565 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:10,565 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,565 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,565 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:10,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:10,567 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:10,567 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:10,567 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:10,567 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,567 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:10,569 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,569 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,569 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:10,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,569 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:10,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:10,570 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:10,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,572 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,572 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:10,572 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,572 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:10,572 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:10,572 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:10,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:10,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:10,572 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:10,573 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,573 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,573 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,573 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:10,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:10,573 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:10,673 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:10,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:10,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:10,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:10,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,680 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:10,680 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:10,680 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:10,680 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:10,681 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,681 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,683 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:10,683 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:10,683 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:10,683 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:10,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,684 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,684 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:10,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:10,684 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:10,684 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:10,684 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:10,684 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:10,685 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:10,685 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:10,685 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. started... 2023-03-11 00:54:10,685 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2dd70ffc836295255740f79f024e3511 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:11,098 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120191cbd6b23a2f4215aa75f9a04b5cc080 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120191cbd6b23a2f4215aa75f9a04b5cc080 2023-03-11 00:54:11,103 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/0387d2c9cec44c7888e084528887e21d 2023-03-11 00:54:11,109 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/0387d2c9cec44c7888e084528887e21d as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/0387d2c9cec44c7888e084528887e21d 2023-03-11 00:54:11,113 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/0387d2c9cec44c7888e084528887e21d, entries=1, sequenceid=13, filesize=4.9 K 2023-03-11 00:54:11,114 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2dd70ffc836295255740f79f024e3511 in 429ms, sequenceid=13, compaction requested=true 2023-03-11 00:54:11,114 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:11,114 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:11,114 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:11,114 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:11,114 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,114 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:11,114 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:11,116 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,116 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:11,117 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,117 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:11,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:11,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:11,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:11,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:11,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@484e458e[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:11,118 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:11,118 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,119 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,119 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:11,119 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,120 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:11,119 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:11,120 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:11,121 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,121 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:11,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:11,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:11,121 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:11,121 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:11,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:11,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:11,123 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:11,123 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:11,123 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:11,123 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,123 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:11,125 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,125 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,126 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:11,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:11,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:11,126 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,127 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,131 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,131 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:11,132 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:11,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:11,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:11,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:11,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:11,132 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:11,132 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,132 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:11,132 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,132 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:11,132 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:11,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:11,132 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,132 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:11,132 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,233 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:11,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:11,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:11,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:11,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,240 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:11,240 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:11,240 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:11,240 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:11,240 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,240 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,242 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:11,242 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:11,242 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:11,242 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,243 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,243 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:11,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:11,243 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:11,244 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. started... 2023-03-11 00:54:11,244 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2dd70ffc836295255740f79f024e3511 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:11,660 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120551fee48bfb124c349361d1e0ee9cfb1a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120551fee48bfb124c349361d1e0ee9cfb1a 2023-03-11 00:54:12,065 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/030accaf34d34c3593aaf276e0156b38 2023-03-11 00:54:12,070 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/030accaf34d34c3593aaf276e0156b38 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/030accaf34d34c3593aaf276e0156b38 2023-03-11 00:54:12,075 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/030accaf34d34c3593aaf276e0156b38, entries=1, sequenceid=17, filesize=4.9 K 2023-03-11 00:54:12,076 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2dd70ffc836295255740f79f024e3511 in 832ms, sequenceid=17, compaction requested=true 2023-03-11 00:54:12,076 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:12,076 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:12,076 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:12,076 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:12,076 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,076 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:12,076 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:12,078 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,078 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:12,079 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:12,079 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:12,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:12,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25aec69d[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:12,080 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:12,080 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,083 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,083 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:12,083 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:12,083 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,083 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:12,083 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:12,084 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:12,084 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,084 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:12,084 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:12,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:12,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:12,087 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:12,087 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:12,087 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:12,087 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,087 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:12,089 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,089 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,089 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:12,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:12,090 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,091 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:12,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:12,098 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,098 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:12,098 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,098 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:12,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:12,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:12,098 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:12,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:12,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:12,098 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:12,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:12,099 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:12,099 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,099 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,099 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,099 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:12,099 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:12,199 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:12,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:12,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:12,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:12,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,206 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:12,206 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:12,206 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:12,206 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:12,207 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,207 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,209 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:12,209 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:12,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:12,209 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:12,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,209 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:12,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,210 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:12,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:12,211 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:12,211 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:12,211 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:12,211 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:12,211 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. started... 2023-03-11 00:54:12,211 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2dd70ffc836295255740f79f024e3511 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:12,629 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122849fdc4e4b8fd4cd59ae8bc2a498f0fc6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122849fdc4e4b8fd4cd59ae8bc2a498f0fc6 2023-03-11 00:54:13,034 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/99bae87b656b45179a7fa45483544c68 2023-03-11 00:54:13,040 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/99bae87b656b45179a7fa45483544c68 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/99bae87b656b45179a7fa45483544c68 2023-03-11 00:54:13,045 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/99bae87b656b45179a7fa45483544c68, entries=1, sequenceid=21, filesize=4.9 K 2023-03-11 00:54:13,045 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2dd70ffc836295255740f79f024e3511 in 834ms, sequenceid=21, compaction requested=true 2023-03-11 00:54:13,046 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:13,046 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:13,046 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:13,046 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:13,046 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,046 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:13,046 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:13,048 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:13,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:13,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:13,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:13,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:13,050 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:13,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6955ed8f[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:13,050 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,051 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,051 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:13,051 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:13,051 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:13,052 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,052 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:13,053 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,053 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:13,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,053 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:13,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:13,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:13,053 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:13,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:13,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:13,055 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:13,055 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:13,055 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:13,055 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,055 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:13,058 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,058 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,058 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:13,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:13,059 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,060 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:13,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,062 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,062 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,062 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,063 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,063 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:13,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:13,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:13,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:13,063 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:13,063 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:13,063 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,063 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,063 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:13,063 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:13,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:13,063 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:13,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:13,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:13,164 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:13,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:13,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:13,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:13,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,171 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:13,171 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:13,171 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:13,171 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:13,171 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,171 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,173 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,173 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:13,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:13,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:13,173 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:13,173 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:13,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:13,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,174 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,174 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:13,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:13,174 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:13,174 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:13,174 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:13,174 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:13,174 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:13,174 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:13,174 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. started... 2023-03-11 00:54:13,174 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2dd70ffc836295255740f79f024e3511 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:13,297 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:54:13,589 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231183cabca44e84850a81c8b88451f801c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231183cabca44e84850a81c8b88451f801c 2023-03-11 00:54:13,997 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/92122ac48b194f48a25ab6d1d767b3dc 2023-03-11 00:54:14,003 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/92122ac48b194f48a25ab6d1d767b3dc as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/92122ac48b194f48a25ab6d1d767b3dc 2023-03-11 00:54:14,009 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/92122ac48b194f48a25ab6d1d767b3dc, entries=1, sequenceid=25, filesize=4.9 K 2023-03-11 00:54:14,010 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2dd70ffc836295255740f79f024e3511 in 836ms, sequenceid=25, compaction requested=true 2023-03-11 00:54:14,010 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:14,010 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:14,010 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:14,011 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:14,011 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,011 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:14,011 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:14,012 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,012 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:14,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:14,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:14,013 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,013 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:14,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:14,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:14,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:14,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38febbb7[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:14,014 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:14,014 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,016 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,017 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:14,017 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:14,017 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:14,017 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,017 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:14,018 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,018 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:14,018 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:14,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:14,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:14,018 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:14,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:14,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:14,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:14,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:14,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:14,021 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:14,021 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:14,021 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:14,021 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,021 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:14,027 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,027 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,027 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:14,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:14,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:14,028 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:14,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:14,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:14,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:14,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,029 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:14,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,031 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:14,031 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:14,031 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,032 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,032 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,032 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:14,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:14,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:14,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:14,032 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,032 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,032 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,032 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:14,032 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:14,032 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:14,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:14,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:14,132 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:14,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:14,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:14,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:14,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,141 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:14,141 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:14,141 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:14,142 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:14,142 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,142 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,144 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,144 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:14,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:14,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:14,144 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,144 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:14,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,145 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,145 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:14,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,145 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:14,146 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:14,146 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:14,147 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:14,147 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:14,147 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:14,147 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. started... 2023-03-11 00:54:14,147 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2dd70ffc836295255740f79f024e3511 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:14,167 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101bb8f39762a4d46c9baa7b8627d20c947 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101bb8f39762a4d46c9baa7b8627d20c947 2023-03-11 00:54:14,178 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/f69190de1bd844e1be91573897e9f2d4 2023-03-11 00:54:14,184 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/f69190de1bd844e1be91573897e9f2d4 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/f69190de1bd844e1be91573897e9f2d4 2023-03-11 00:54:14,189 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/f69190de1bd844e1be91573897e9f2d4, entries=1, sequenceid=29, filesize=4.9 K 2023-03-11 00:54:14,190 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2dd70ffc836295255740f79f024e3511 in 43ms, sequenceid=29, compaction requested=true 2023-03-11 00:54:14,190 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:14,190 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:14,190 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:14,190 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:14,190 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,190 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:14,190 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:14,193 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,193 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:14,193 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,193 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:14,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:14,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:14,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@226eb13[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:14,195 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:14,195 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,196 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,196 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:14,196 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:14,196 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,196 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:14,196 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:14,198 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:14,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:14,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:14,199 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:14,199 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:14,199 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:14,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:14,201 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:14,201 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:14,201 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:14,201 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,201 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:14,203 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,203 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:14,203 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:14,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:14,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:14,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:14,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:14,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,204 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,205 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:14,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,208 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,208 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:14,208 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:14,208 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:14,208 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:14,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:14,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:14,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:14,208 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,209 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,209 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,209 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,209 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:14,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:14,209 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:14,209 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:14,309 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:14,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:14,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:14,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:14,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,319 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:14,319 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:14,319 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:14,319 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:14,319 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,319 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,320 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,320 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:14,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:14,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:14,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:14,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,322 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,322 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,322 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:14,322 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:14,322 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,322 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:14,322 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:14,322 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:14,323 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:14,323 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:14,323 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:14,323 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. started... 2023-03-11 00:54:14,323 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2dd70ffc836295255740f79f024e3511 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:14,344 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034e434cbda9e746f5ad07732187e4deab to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034e434cbda9e746f5ad07732187e4deab 2023-03-11 00:54:14,354 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/21f380a6e6d841458d2cfe0b3caeb3f3 2023-03-11 00:54:14,359 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/21f380a6e6d841458d2cfe0b3caeb3f3 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/21f380a6e6d841458d2cfe0b3caeb3f3 2023-03-11 00:54:14,364 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/21f380a6e6d841458d2cfe0b3caeb3f3, entries=1, sequenceid=33, filesize=4.9 K 2023-03-11 00:54:14,365 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2dd70ffc836295255740f79f024e3511 in 42ms, sequenceid=33, compaction requested=true 2023-03-11 00:54:14,366 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:14,366 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:14,366 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:14,366 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:14,366 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,366 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:14,366 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:14,368 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,368 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:14,368 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,368 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:14,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:14,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51ef4fe4[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:14,370 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:14,370 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,372 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,372 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:14,372 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:14,372 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:14,372 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,372 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:14,374 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:14,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:14,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:14,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:14,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,376 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:14,376 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:14,376 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:14,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:14,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:14,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:14,377 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:14,378 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:14,378 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:14,378 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,378 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:14,380 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,380 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,380 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:14,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:14,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:14,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:14,380 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:14,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:14,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:14,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,382 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:14,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,385 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:14,385 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:14,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:14,385 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,385 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,385 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,385 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,385 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,385 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,385 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,385 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:14,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:14,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:14,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:14,386 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:14,386 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:14,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:14,486 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:14,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:14,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:14,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:14,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,494 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:14,494 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:14,494 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:14,494 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:14,494 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,494 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,495 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,496 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:14,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:14,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:14,496 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:14,496 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:14,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:14,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,497 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,497 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:14,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:14,497 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:14,497 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:14,497 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:14,498 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:14,498 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:14,498 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:14,498 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. started... 2023-03-11 00:54:14,498 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2dd70ffc836295255740f79f024e3511 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:14,922 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907266e0fa7a19c4751b85a748d3d76d623 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907266e0fa7a19c4751b85a748d3d76d623 2023-03-11 00:54:15,330 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/e61ebc01fa4e4c8f9cf579508611458a 2023-03-11 00:54:15,336 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/e61ebc01fa4e4c8f9cf579508611458a as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/e61ebc01fa4e4c8f9cf579508611458a 2023-03-11 00:54:15,341 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/e61ebc01fa4e4c8f9cf579508611458a, entries=1, sequenceid=37, filesize=4.9 K 2023-03-11 00:54:15,342 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2dd70ffc836295255740f79f024e3511 in 844ms, sequenceid=37, compaction requested=true 2023-03-11 00:54:15,342 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:15,342 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:15,343 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:15,343 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:15,343 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,343 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:15,343 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:15,345 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:15,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:15,345 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:15,346 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,346 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:15,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:15,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:15,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:15,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1790f9c3[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:15,347 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:15,348 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,351 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,351 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:15,351 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:15,351 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,352 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:15,351 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:15,353 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,353 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:15,353 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:15,353 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:15,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:15,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:15,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:15,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:15,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:15,356 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:15,356 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:15,356 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:15,356 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,356 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:15,357 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,357 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,357 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:15,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,358 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,359 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:15,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,363 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,363 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,363 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:15,363 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,363 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:15,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:15,363 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:15,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:15,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:15,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:15,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:15,363 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,363 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,363 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,363 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:15,364 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:15,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:15,364 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:15,464 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:15,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:15,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:15,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:15,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,471 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:15,471 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:15,471 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:15,471 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:15,472 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,472 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,473 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:15,473 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:15,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:15,473 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,473 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:15,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:15,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,474 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,474 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:15,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,475 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:15,475 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:15,475 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:15,475 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:15,475 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:15,475 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:15,475 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. started... 2023-03-11 00:54:15,475 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2dd70ffc836295255740f79f024e3511 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:15,890 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120348c6dcaebdb4205b0cdbf05dc0aa333 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120348c6dcaebdb4205b0cdbf05dc0aa333 2023-03-11 00:54:15,895 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/14f5d5b9ba864615a4dc84be602c6aab 2023-03-11 00:54:15,901 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/14f5d5b9ba864615a4dc84be602c6aab as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/14f5d5b9ba864615a4dc84be602c6aab 2023-03-11 00:54:15,906 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/14f5d5b9ba864615a4dc84be602c6aab, entries=1, sequenceid=41, filesize=4.9 K 2023-03-11 00:54:15,907 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2dd70ffc836295255740f79f024e3511 in 432ms, sequenceid=41, compaction requested=true 2023-03-11 00:54:15,907 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:15,908 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:15,908 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:15,908 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:15,908 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,908 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:15,908 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:15,910 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:15,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:15,910 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:15,911 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,911 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:15,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:15,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a7ecb85[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:15,912 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:15,912 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,913 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,914 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:15,914 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:15,914 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,914 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:15,914 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:15,916 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,916 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:15,916 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:15,916 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:15,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:15,919 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:15,919 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:15,919 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:15,919 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,919 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:15,921 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,921 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:15,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:15,921 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:15,922 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:15,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:15,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:15,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:15,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,923 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:15,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,926 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:15,926 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:15,926 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:15,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:15,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 00:54:15,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:15,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:15,926 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:15,926 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,927 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,927 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:15,927 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:15,927 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:15,927 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,927 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:15,927 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:16,027 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:16,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:16,029 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-11 00:54:16,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:54:16,032 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:54:16,033 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496656033 2023-03-11 00:54:16,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:16,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 00:54:16,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-11 00:54:16,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:16,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x32a7127e to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:54:16,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7be50a9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:54:16,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:16,904 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010348dbe5dfdc554c779998e91156c1e84a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010348dbe5dfdc554c779998e91156c1e84a 2023-03-11 00:54:16,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:16,919 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:54:16,920 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38586, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:54:16,927 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:54:16,929 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41732, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:54:16,950 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bf1c29610e5c42c09c6b5c00b8366cfb first=Optional[r3] last=Optional[r6] 2023-03-11 00:54:16,950 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bf1c29610e5c42c09c6b5c00b8366cfb}] 2023-03-11 00:54:16,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bf1c29610e5c42c09c6b5c00b8366cfb for inclusion in 2dd70ffc836295255740f79f024e3511/family1 2023-03-11 00:54:16,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-11 00:54:16,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:54:16,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:16,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bf1c29610e5c42c09c6b5c00b8366cfb to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithWeeklyPolicy__d1g0bei4nfus5ghbu0rb4cu8e528uovaiv6l512uge0456ju71mgmbu35av0aq7u/family1/bf1c29610e5c42c09c6b5c00b8366cfb 2023-03-11 00:54:16,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithWeeklyPolicy__d1g0bei4nfus5ghbu0rb4cu8e528uovaiv6l512uge0456ju71mgmbu35av0aq7u/family1/bf1c29610e5c42c09c6b5c00b8366cfb as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/453b8999449a4c7982291bf3ec0d5a1c_SeqId_44_ 2023-03-11 00:54:16,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithWeeklyPolicy__d1g0bei4nfus5ghbu0rb4cu8e528uovaiv6l512uge0456ju71mgmbu35av0aq7u/family1/bf1c29610e5c42c09c6b5c00b8366cfb into 2dd70ffc836295255740f79f024e3511/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/453b8999449a4c7982291bf3ec0d5a1c_SeqId_44_ - updating store file list. 2023-03-11 00:54:16,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/453b8999449a4c7982291bf3ec0d5a1c_SeqId_44_ into 2dd70ffc836295255740f79f024e3511/family1 2023-03-11 00:54:16,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithWeeklyPolicy__d1g0bei4nfus5ghbu0rb4cu8e528uovaiv6l512uge0456ju71mgmbu35av0aq7u/family1/bf1c29610e5c42c09c6b5c00b8366cfb into 2dd70ffc836295255740f79f024e3511/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/453b8999449a4c7982291bf3ec0d5a1c_SeqId_44_) 2023-03-11 00:54:16,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithWeeklyPolicy__d1g0bei4nfus5ghbu0rb4cu8e528uovaiv6l512uge0456ju71mgmbu35av0aq7u/family1/bf1c29610e5c42c09c6b5c00b8366cfb 2023-03-11 00:54:16,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 00:54:16,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 00:54:16,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 2dd70ffc836295255740f79f024e3511/family1 is initiating minor compaction 2023-03-11 00:54:16,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@48295b6a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:16,974 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2dd70ffc836295255740f79f024e3511/family1 in testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:54:16,974 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/c67e294b1ecb41a09f0981aedeaeac6a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/0387d2c9cec44c7888e084528887e21d, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/030accaf34d34c3593aaf276e0156b38, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/99bae87b656b45179a7fa45483544c68, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/92122ac48b194f48a25ab6d1d767b3dc, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/f69190de1bd844e1be91573897e9f2d4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/21f380a6e6d841458d2cfe0b3caeb3f3, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/e61ebc01fa4e4c8f9cf579508611458a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/14f5d5b9ba864615a4dc84be602c6aab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/453b8999449a4c7982291bf3ec0d5a1c_SeqId_44_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp, totalSize=50.0 K 2023-03-11 00:54:16,975 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting c67e294b1ecb41a09f0981aedeaeac6a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 00:54:16,975 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 0387d2c9cec44c7888e084528887e21d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 00:54:16,975 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 030accaf34d34c3593aaf276e0156b38, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 00:54:16,975 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 99bae87b656b45179a7fa45483544c68, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 00:54:16,975 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 92122ac48b194f48a25ab6d1d767b3dc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 00:54:16,975 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting f69190de1bd844e1be91573897e9f2d4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 00:54:16,975 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 21f380a6e6d841458d2cfe0b3caeb3f3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 00:54:16,975 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting e61ebc01fa4e4c8f9cf579508611458a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 00:54:16,975 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 14f5d5b9ba864615a4dc84be602c6aab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 00:54:16,975 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 453b8999449a4c7982291bf3ec0d5a1c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 00:54:16,976 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:16,977 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:16,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122849fdc4e4b8fd4cd59ae8bc2a498f0fc6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122849fdc4e4b8fd4cd59ae8bc2a498f0fc6 2023-03-11 00:54:16,981 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231183cabca44e84850a81c8b88451f801c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231183cabca44e84850a81c8b88451f801c 2023-03-11 00:54:16,982 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101bb8f39762a4d46c9baa7b8627d20c947 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101bb8f39762a4d46c9baa7b8627d20c947 2023-03-11 00:54:16,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034e434cbda9e746f5ad07732187e4deab to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034e434cbda9e746f5ad07732187e4deab 2023-03-11 00:54:16,984 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-11 00:54:16,985 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-11 00:54:16,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:16,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:16,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:16,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:16,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:16,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:16,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:16,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:17,012 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2dd70ffc836295255740f79f024e3511#family1#compaction#34 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:54:17,436 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f63b0b0c2a354d0d8041d3076979ab84 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205f63b0b0c2a354d0d8041d3076979ab84 2023-03-11 00:54:17,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:17,465 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a15be3144d754702944318a45834c4e2 first=Optional[r1] last=Optional[r2] 2023-03-11 00:54:17,465 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a15be3144d754702944318a45834c4e2}] 2023-03-11 00:54:17,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a15be3144d754702944318a45834c4e2 for inclusion in 2dd70ffc836295255740f79f024e3511/family1 2023-03-11 00:54:17,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-11 00:54:17,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:54:17,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:17,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a15be3144d754702944318a45834c4e2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2otiikpahjb439emsregap5r3agc929gsr9nenjd4tl59c7ovu1kmu30qh8h2e2/family1/a15be3144d754702944318a45834c4e2 2023-03-11 00:54:17,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2otiikpahjb439emsregap5r3agc929gsr9nenjd4tl59c7ovu1kmu30qh8h2e2/family1/a15be3144d754702944318a45834c4e2 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/af346d2d633c42eda6c18408b1f7e895_SeqId_46_ 2023-03-11 00:54:17,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2otiikpahjb439emsregap5r3agc929gsr9nenjd4tl59c7ovu1kmu30qh8h2e2/family1/a15be3144d754702944318a45834c4e2 into 2dd70ffc836295255740f79f024e3511/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/af346d2d633c42eda6c18408b1f7e895_SeqId_46_ - updating store file list. 2023-03-11 00:54:17,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/af346d2d633c42eda6c18408b1f7e895_SeqId_46_ into 2dd70ffc836295255740f79f024e3511/family1 2023-03-11 00:54:17,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2otiikpahjb439emsregap5r3agc929gsr9nenjd4tl59c7ovu1kmu30qh8h2e2/family1/a15be3144d754702944318a45834c4e2 into 2dd70ffc836295255740f79f024e3511/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/af346d2d633c42eda6c18408b1f7e895_SeqId_46_) 2023-03-11 00:54:17,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2otiikpahjb439emsregap5r3agc929gsr9nenjd4tl59c7ovu1kmu30qh8h2e2/family1/a15be3144d754702944318a45834c4e2 2023-03-11 00:54:17,482 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:17,483 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:17,485 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120191cbd6b23a2f4215aa75f9a04b5cc080 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120191cbd6b23a2f4215aa75f9a04b5cc080 2023-03-11 00:54:17,486 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120551fee48bfb124c349361d1e0ee9cfb1a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120551fee48bfb124c349361d1e0ee9cfb1a 2023-03-11 00:54:17,486 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-11 00:54:17,486 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-11 00:54:17,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:17,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:17,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:17,488 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:54:17,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4580 sec 2023-03-11 00:54:17,609 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=260 (was 254) - Thread LEAK? -, OpenFileDescriptor=636 (was 607) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 269), ProcessCount=170 (was 170), AvailableMemoryMB=5464 (was 6075) 2023-03-11 00:54:17,621 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=170, AvailableMemoryMB=5464 2023-03-11 00:54:17,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-11 00:54:17,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:17,626 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:54:17,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-11 00:54:17,627 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:54:17,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 00:54:17,629 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:54:17,629 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:54:17,629 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:54:17,630 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db empty. 2023-03-11 00:54:17,630 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002 empty. 2023-03-11 00:54:17,630 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2 empty. 2023-03-11 00:54:17,630 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:54:17,630 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:54:17,630 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:54:17,630 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-11 00:54:17,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 00:54:17,839 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/.tmp/family1/9e34106644454082bacafe6a21d2864c as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/9e34106644454082bacafe6a21d2864c 2023-03-11 00:54:17,845 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 2dd70ffc836295255740f79f024e3511/family1 of 2dd70ffc836295255740f79f024e3511 into 9e34106644454082bacafe6a21d2864c(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:54:17,845 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:54:17,846 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678496056974; duration=0sec 2023-03-11 00:54:17,847 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:17,852 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/c67e294b1ecb41a09f0981aedeaeac6a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/0387d2c9cec44c7888e084528887e21d, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/030accaf34d34c3593aaf276e0156b38, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/99bae87b656b45179a7fa45483544c68, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/92122ac48b194f48a25ab6d1d767b3dc, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/f69190de1bd844e1be91573897e9f2d4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/21f380a6e6d841458d2cfe0b3caeb3f3, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/e61ebc01fa4e4c8f9cf579508611458a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/14f5d5b9ba864615a4dc84be602c6aab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/453b8999449a4c7982291bf3ec0d5a1c_SeqId_44_] to archive 2023-03-11 00:54:17,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:17,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/c67e294b1ecb41a09f0981aedeaeac6a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/c67e294b1ecb41a09f0981aedeaeac6a 2023-03-11 00:54:17,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/0387d2c9cec44c7888e084528887e21d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/0387d2c9cec44c7888e084528887e21d 2023-03-11 00:54:17,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/030accaf34d34c3593aaf276e0156b38 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/030accaf34d34c3593aaf276e0156b38 2023-03-11 00:54:17,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/99bae87b656b45179a7fa45483544c68 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/99bae87b656b45179a7fa45483544c68 2023-03-11 00:54:17,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/92122ac48b194f48a25ab6d1d767b3dc to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/92122ac48b194f48a25ab6d1d767b3dc 2023-03-11 00:54:17,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/f69190de1bd844e1be91573897e9f2d4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/f69190de1bd844e1be91573897e9f2d4 2023-03-11 00:54:17,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/21f380a6e6d841458d2cfe0b3caeb3f3 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/21f380a6e6d841458d2cfe0b3caeb3f3 2023-03-11 00:54:17,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/e61ebc01fa4e4c8f9cf579508611458a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/e61ebc01fa4e4c8f9cf579508611458a 2023-03-11 00:54:17,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/14f5d5b9ba864615a4dc84be602c6aab to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/14f5d5b9ba864615a4dc84be602c6aab 2023-03-11 00:54:17,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/453b8999449a4c7982291bf3ec0d5a1c_SeqId_44_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/family1/453b8999449a4c7982291bf3ec0d5a1c_SeqId_44_ 2023-03-11 00:54:17,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 00:54:18,039 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-11 00:54:18,041 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2b37f493ceeadf41ebe7d2e9f0d628c2, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:54:18,041 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 78c948ce5e0a1cdee67cd729e4b6b9db, NAME => 'testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:54:18,041 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 19f6bc8c94651102c50eaacf1b54c002, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:54:18,059 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:18,059 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 2b37f493ceeadf41ebe7d2e9f0d628c2, disabling compactions & flushes 2023-03-11 00:54:18,059 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:18,059 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:18,059 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. after waiting 0 ms 2023-03-11 00:54:18,059 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:18,059 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:18,059 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 2b37f493ceeadf41ebe7d2e9f0d628c2: 2023-03-11 00:54:18,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 00:54:18,458 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:18,458 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 19f6bc8c94651102c50eaacf1b54c002, disabling compactions & flushes 2023-03-11 00:54:18,458 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:18,458 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:18,458 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. after waiting 0 ms 2023-03-11 00:54:18,458 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:18,459 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:18,459 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 19f6bc8c94651102c50eaacf1b54c002: 2023-03-11 00:54:18,459 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:18,460 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 78c948ce5e0a1cdee67cd729e4b6b9db, disabling compactions & flushes 2023-03-11 00:54:18,460 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:18,460 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:18,460 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. after waiting 0 ms 2023-03-11 00:54:18,460 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:18,460 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:18,460 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 78c948ce5e0a1cdee67cd729e4b6b9db: 2023-03-11 00:54:18,462 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:54:18,463 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678496058463"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496058463"}]},"ts":"1678496058463"} 2023-03-11 00:54:18,463 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678496058463"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496058463"}]},"ts":"1678496058463"} 2023-03-11 00:54:18,463 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678496058463"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496058463"}]},"ts":"1678496058463"} 2023-03-11 00:54:18,466 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-11 00:54:18,467 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:54:18,468 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496058468"}]},"ts":"1678496058468"} 2023-03-11 00:54:18,469 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-11 00:54:18,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=78c948ce5e0a1cdee67cd729e4b6b9db, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=19f6bc8c94651102c50eaacf1b54c002, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2b37f493ceeadf41ebe7d2e9f0d628c2, ASSIGN}] 2023-03-11 00:54:18,475 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2b37f493ceeadf41ebe7d2e9f0d628c2, ASSIGN 2023-03-11 00:54:18,475 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=19f6bc8c94651102c50eaacf1b54c002, ASSIGN 2023-03-11 00:54:18,475 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=78c948ce5e0a1cdee67cd729e4b6b9db, ASSIGN 2023-03-11 00:54:18,476 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2b37f493ceeadf41ebe7d2e9f0d628c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:54:18,476 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=19f6bc8c94651102c50eaacf1b54c002, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:54:18,476 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=78c948ce5e0a1cdee67cd729e4b6b9db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:54:18,627 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=19f6bc8c94651102c50eaacf1b54c002, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:18,627 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=78c948ce5e0a1cdee67cd729e4b6b9db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:18,627 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2b37f493ceeadf41ebe7d2e9f0d628c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:18,628 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678496058627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496058627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496058627"}]},"ts":"1678496058627"} 2023-03-11 00:54:18,628 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678496058627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496058627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496058627"}]},"ts":"1678496058627"} 2023-03-11 00:54:18,628 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678496058627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496058627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496058627"}]},"ts":"1678496058627"} 2023-03-11 00:54:18,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 19f6bc8c94651102c50eaacf1b54c002, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:18,630 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 78c948ce5e0a1cdee67cd729e4b6b9db, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:18,631 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 2b37f493ceeadf41ebe7d2e9f0d628c2, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:18,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 00:54:18,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:18,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19f6bc8c94651102c50eaacf1b54c002, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002.', STARTKEY => '1', ENDKEY => '2'} 2023-03-11 00:54:18,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:54:18,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:18,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:54:18,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:54:18,786 INFO [StoreOpener-19f6bc8c94651102c50eaacf1b54c002-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:54:18,788 DEBUG [StoreOpener-19f6bc8c94651102c50eaacf1b54c002-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002/family1 2023-03-11 00:54:18,788 DEBUG [StoreOpener-19f6bc8c94651102c50eaacf1b54c002-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002/family1 2023-03-11 00:54:18,788 INFO [StoreOpener-19f6bc8c94651102c50eaacf1b54c002-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19f6bc8c94651102c50eaacf1b54c002 columnFamilyName family1 2023-03-11 00:54:18,790 INFO [StoreOpener-19f6bc8c94651102c50eaacf1b54c002-1] regionserver.HStore(310): Store=19f6bc8c94651102c50eaacf1b54c002/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:18,790 INFO [StoreOpener-19f6bc8c94651102c50eaacf1b54c002-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:54:18,791 DEBUG [StoreOpener-19f6bc8c94651102c50eaacf1b54c002-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002/family2 2023-03-11 00:54:18,791 DEBUG [StoreOpener-19f6bc8c94651102c50eaacf1b54c002-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002/family2 2023-03-11 00:54:18,792 INFO [StoreOpener-19f6bc8c94651102c50eaacf1b54c002-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19f6bc8c94651102c50eaacf1b54c002 columnFamilyName family2 2023-03-11 00:54:18,793 INFO [StoreOpener-19f6bc8c94651102c50eaacf1b54c002-1] regionserver.HStore(310): Store=19f6bc8c94651102c50eaacf1b54c002/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:18,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:54:18,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:54:18,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:54:18,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:54:18,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:54:18,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 19f6bc8c94651102c50eaacf1b54c002; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65161902, jitterRate=-0.02901199460029602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:54:18,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 19f6bc8c94651102c50eaacf1b54c002: 2023-03-11 00:54:18,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002., pid=31, masterSystemTime=1678496058781 2023-03-11 00:54:18,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:18,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:18,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 78c948ce5e0a1cdee67cd729e4b6b9db, NAME => 'testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db.', STARTKEY => '', ENDKEY => '1'} 2023-03-11 00:54:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:54:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:18,804 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=19f6bc8c94651102c50eaacf1b54c002, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:54:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:54:18,804 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678496058804"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496058804"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496058804"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496058804"}]},"ts":"1678496058804"} 2023-03-11 00:54:18,806 INFO [StoreOpener-78c948ce5e0a1cdee67cd729e4b6b9db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:54:18,807 DEBUG [StoreOpener-78c948ce5e0a1cdee67cd729e4b6b9db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db/family1 2023-03-11 00:54:18,807 DEBUG [StoreOpener-78c948ce5e0a1cdee67cd729e4b6b9db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db/family1 2023-03-11 00:54:18,808 INFO [StoreOpener-78c948ce5e0a1cdee67cd729e4b6b9db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78c948ce5e0a1cdee67cd729e4b6b9db columnFamilyName family1 2023-03-11 00:54:18,808 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-03-11 00:54:18,808 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 19f6bc8c94651102c50eaacf1b54c002, server=jenkins-hbase4.apache.org,38819,1678496016129 in 177 msec 2023-03-11 00:54:18,809 INFO [StoreOpener-78c948ce5e0a1cdee67cd729e4b6b9db-1] regionserver.HStore(310): Store=78c948ce5e0a1cdee67cd729e4b6b9db/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:18,809 INFO [StoreOpener-78c948ce5e0a1cdee67cd729e4b6b9db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:54:18,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=19f6bc8c94651102c50eaacf1b54c002, ASSIGN in 335 msec 2023-03-11 00:54:18,811 DEBUG [StoreOpener-78c948ce5e0a1cdee67cd729e4b6b9db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db/family2 2023-03-11 00:54:18,811 DEBUG [StoreOpener-78c948ce5e0a1cdee67cd729e4b6b9db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db/family2 2023-03-11 00:54:18,812 INFO [StoreOpener-78c948ce5e0a1cdee67cd729e4b6b9db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78c948ce5e0a1cdee67cd729e4b6b9db columnFamilyName family2 2023-03-11 00:54:18,813 INFO [StoreOpener-78c948ce5e0a1cdee67cd729e4b6b9db-1] regionserver.HStore(310): Store=78c948ce5e0a1cdee67cd729e4b6b9db/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:18,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:54:18,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:54:18,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:54:18,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:54:18,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:54:18,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 78c948ce5e0a1cdee67cd729e4b6b9db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63689628, jitterRate=-0.050950586795806885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:54:18,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 78c948ce5e0a1cdee67cd729e4b6b9db: 2023-03-11 00:54:18,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db., pid=32, masterSystemTime=1678496058781 2023-03-11 00:54:18,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:18,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:18,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:18,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b37f493ceeadf41ebe7d2e9f0d628c2, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2.', STARTKEY => '2', ENDKEY => ''} 2023-03-11 00:54:18,822 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=78c948ce5e0a1cdee67cd729e4b6b9db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:18,822 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678496058822"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496058822"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496058822"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496058822"}]},"ts":"1678496058822"} 2023-03-11 00:54:18,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:54:18,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:18,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:54:18,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:54:18,824 INFO [StoreOpener-2b37f493ceeadf41ebe7d2e9f0d628c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:54:18,825 DEBUG [StoreOpener-2b37f493ceeadf41ebe7d2e9f0d628c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1 2023-03-11 00:54:18,825 DEBUG [StoreOpener-2b37f493ceeadf41ebe7d2e9f0d628c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1 2023-03-11 00:54:18,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-03-11 00:54:18,826 INFO [StoreOpener-2b37f493ceeadf41ebe7d2e9f0d628c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b37f493ceeadf41ebe7d2e9f0d628c2 columnFamilyName family1 2023-03-11 00:54:18,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 78c948ce5e0a1cdee67cd729e4b6b9db, server=jenkins-hbase4.apache.org,38819,1678496016129 in 194 msec 2023-03-11 00:54:18,827 INFO [StoreOpener-2b37f493ceeadf41ebe7d2e9f0d628c2-1] regionserver.HStore(310): Store=2b37f493ceeadf41ebe7d2e9f0d628c2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:18,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=78c948ce5e0a1cdee67cd729e4b6b9db, ASSIGN in 353 msec 2023-03-11 00:54:18,827 INFO [StoreOpener-2b37f493ceeadf41ebe7d2e9f0d628c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:54:18,828 DEBUG [StoreOpener-2b37f493ceeadf41ebe7d2e9f0d628c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family2 2023-03-11 00:54:18,828 DEBUG [StoreOpener-2b37f493ceeadf41ebe7d2e9f0d628c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family2 2023-03-11 00:54:18,829 INFO [StoreOpener-2b37f493ceeadf41ebe7d2e9f0d628c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b37f493ceeadf41ebe7d2e9f0d628c2 columnFamilyName family2 2023-03-11 00:54:18,829 INFO [StoreOpener-2b37f493ceeadf41ebe7d2e9f0d628c2-1] regionserver.HStore(310): Store=2b37f493ceeadf41ebe7d2e9f0d628c2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:18,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:54:18,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:54:18,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:54:18,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:54:18,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:54:18,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2b37f493ceeadf41ebe7d2e9f0d628c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60678803, jitterRate=-0.09581537544727325}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:54:18,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2b37f493ceeadf41ebe7d2e9f0d628c2: 2023-03-11 00:54:18,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2., pid=33, masterSystemTime=1678496058781 2023-03-11 00:54:18,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:18,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:18,838 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2b37f493ceeadf41ebe7d2e9f0d628c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:18,838 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678496058838"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496058838"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496058838"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496058838"}]},"ts":"1678496058838"} 2023-03-11 00:54:18,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-03-11 00:54:18,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 2b37f493ceeadf41ebe7d2e9f0d628c2, server=jenkins-hbase4.apache.org,38819,1678496016129 in 209 msec 2023-03-11 00:54:18,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=27 2023-03-11 00:54:18,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2b37f493ceeadf41ebe7d2e9f0d628c2, ASSIGN in 369 msec 2023-03-11 00:54:18,844 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:54:18,845 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496058845"}]},"ts":"1678496058845"} 2023-03-11 00:54:18,846 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-11 00:54:18,848 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:54:18,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2250 sec 2023-03-11 00:54:19,413 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-11 00:54:19,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 00:54:19,733 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-11 00:54:19,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:19,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:19,742 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-11 00:54:19,742 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:19,742 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-11 00:54:19,742 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-11 00:54:19,742 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:19,743 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:19,744 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:19,744 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:19,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:19,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:19,744 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:19,744 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:19,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:19,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:19,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:19,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:19,745 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:19,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:19,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-11 00:54:19,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:19,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-11 00:54:19,746 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:19,746 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:54:19,746 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:19,746 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. started... 2023-03-11 00:54:19,746 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:19,771 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:19,772 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 19f6bc8c94651102c50eaacf1b54c002: 2023-03-11 00:54:19,771 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. started... 2023-03-11 00:54:19,772 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:19,772 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2b37f493ceeadf41ebe7d2e9f0d628c2 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-11 00:54:19,772 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. started... 2023-03-11 00:54:19,772 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:54:19,773 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 78c948ce5e0a1cdee67cd729e4b6b9db: 2023-03-11 00:54:19,772 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:54:19,773 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:19,773 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:54:19,774 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32a7127e to 127.0.0.1:62412 2023-03-11 00:54:19,774 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:54:19,775 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:54:19,775 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0973083e to 127.0.0.1:62412 2023-03-11 00:54:19,775 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:54:19,775 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:54:19,775 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f7f09b7 to 127.0.0.1:62412 2023-03-11 00:54:19,775 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:54:19,775 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:54:19,775 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69fb9fc7 to 127.0.0.1:62412 2023-03-11 00:54:19,775 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:54:20,190 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303118b08fa688bb545dd9812e936060c9f28 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303118b08fa688bb545dd9812e936060c9f28 2023-03-11 00:54:20,597 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/.tmp/family1/5a5f0268c05147acaf003087a9a0c657 2023-03-11 00:54:20,602 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/.tmp/family1/5a5f0268c05147acaf003087a9a0c657 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/5a5f0268c05147acaf003087a9a0c657 2023-03-11 00:54:20,607 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/5a5f0268c05147acaf003087a9a0c657, entries=1, sequenceid=5, filesize=4.9 K 2023-03-11 00:54:20,608 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 2b37f493ceeadf41ebe7d2e9f0d628c2 in 836ms, sequenceid=5, compaction requested=false 2023-03-11 00:54:20,609 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2b37f493ceeadf41ebe7d2e9f0d628c2: 2023-03-11 00:54:20,609 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:54:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:54:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-11 00:54:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-11 00:54:20,612 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,612 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:20,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:20,612 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:20,612 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:20,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:20,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:20,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-11 00:54:20,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fb5cdaa[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:20,614 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-11 00:54:20,614 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,616 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-11 00:54:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-11 00:54:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:20,616 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,616 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:20,618 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-11 00:54:20,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,618 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:20,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:20,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:20,618 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-11 00:54:20,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:20,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:20,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:20,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:20,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-11 00:54:20,620 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-11 00:54:20,620 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:20,620 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:20,621 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,621 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:20,622 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,622 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,622 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:20,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:20,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:20,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:20,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:20,623 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:20,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,624 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:20,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,630 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,630 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,630 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:20,630 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:20,630 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-11 00:54:20,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:20,630 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:20,630 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:20,630 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:20,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-11 00:54:20,631 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,631 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:20,631 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,631 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:20,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:20,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:20,731 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:20,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:20,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:20,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:20,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,738 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-11 00:54:20,738 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:20,738 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-11 00:54:20,738 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-11 00:54:20,738 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,739 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,740 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,740 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:20,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:20,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:20,741 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:20,741 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:20,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:20,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,741 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,741 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-11 00:54:20,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-11 00:54:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-11 00:54:20,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:54:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:20,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:20,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. started... 2023-03-11 00:54:20,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:20,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. started... 2023-03-11 00:54:20,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. started... 2023-03-11 00:54:20,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 19f6bc8c94651102c50eaacf1b54c002: 2023-03-11 00:54:20,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:54:20,742 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2b37f493ceeadf41ebe7d2e9f0d628c2 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-11 00:54:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:54:20,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 78c948ce5e0a1cdee67cd729e4b6b9db: 2023-03-11 00:54:20,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:54:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:54:21,159 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031153fc83d97c414e3d9bd23241e895f6f3 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023031153fc83d97c414e3d9bd23241e895f6f3 2023-03-11 00:54:21,566 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/.tmp/family1/9600cca02bdb488ebf33e855f71b34db 2023-03-11 00:54:21,571 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/.tmp/family1/9600cca02bdb488ebf33e855f71b34db as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9600cca02bdb488ebf33e855f71b34db 2023-03-11 00:54:21,576 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9600cca02bdb488ebf33e855f71b34db, entries=2, sequenceid=9, filesize=5.0 K 2023-03-11 00:54:21,577 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 2b37f493ceeadf41ebe7d2e9f0d628c2 in 835ms, sequenceid=9, compaction requested=false 2023-03-11 00:54:21,577 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2b37f493ceeadf41ebe7d2e9f0d628c2: 2023-03-11 00:54:21,577 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:21,577 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:54:21,577 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:54:21,577 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,577 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-11 00:54:21,577 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-11 00:54:21,579 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,579 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:21,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:21,579 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,579 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:21,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-11 00:54:21,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@448e2fd7[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:21,581 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-11 00:54:21,581 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,582 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-11 00:54:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-11 00:54:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:21,582 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,583 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:21,584 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-11 00:54:21,584 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:21,584 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,585 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-11 00:54:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:21,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-11 00:54:21,587 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-11 00:54:21,587 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:21,587 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:21,587 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,587 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:21,588 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,588 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:21,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,588 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:21,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:21,589 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,590 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,592 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,592 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:21,592 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:21,592 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:21,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-11 00:54:21,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:21,592 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,592 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:21,593 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:21,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:21,593 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,593 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:21,593 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,593 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,593 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:21,693 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:21,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:21,701 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-11 00:54:21,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-11 00:54:21,703 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-11 00:54:21,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:21,704 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496661704 2023-03-11 00:54:21,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:54:21,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-11 00:54:21,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-11 00:54:21,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x6dfa94f1 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:54:21,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e18fa07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:54:21,710 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230311 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-11 00:54:22,545 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031187e42d8346774982b7f161170d9f78d9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023031187e42d8346774982b7f161170d9f78d9 2023-03-11 00:54:22,546 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-11 00:54:22,558 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:54:22,559 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38596, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:54:22,566 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:54:22,568 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41748, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:54:22,576 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230311/family1/e6176af8b4f94f739603bf55aa33c914 first=Optional[k0] last=Optional[k1] 2023-03-11 00:54:22,577 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230311/family1/e6176af8b4f94f739603bf55aa33c914}] 2023-03-11 00:54:22,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230311/family1/e6176af8b4f94f739603bf55aa33c914 for inclusion in 2b37f493ceeadf41ebe7d2e9f0d628c2/family1 2023-03-11 00:54:22,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-11 00:54:22,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-11 00:54:22,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 2b37f493ceeadf41ebe7d2e9f0d628c2: 2023-03-11 00:54:22,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230311/family1/e6176af8b4f94f739603bf55aa33c914 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testScannerOnBulkLoadRefHFiles__9i4dlks1ucknv4keh2f08u4df9ab4cf0l58ppfaai799b432nllt2b3a3al62vt5/family1/e6176af8b4f94f739603bf55aa33c914 2023-03-11 00:54:22,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testScannerOnBulkLoadRefHFiles__9i4dlks1ucknv4keh2f08u4df9ab4cf0l58ppfaai799b432nllt2b3a3al62vt5/family1/e6176af8b4f94f739603bf55aa33c914 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9cb4e0d644ca4b079e90450e60114d29_SeqId_12_ 2023-03-11 00:54:22,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testScannerOnBulkLoadRefHFiles__9i4dlks1ucknv4keh2f08u4df9ab4cf0l58ppfaai799b432nllt2b3a3al62vt5/family1/e6176af8b4f94f739603bf55aa33c914 into 2b37f493ceeadf41ebe7d2e9f0d628c2/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9cb4e0d644ca4b079e90450e60114d29_SeqId_12_ - updating store file list. 2023-03-11 00:54:22,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9cb4e0d644ca4b079e90450e60114d29_SeqId_12_ into 2b37f493ceeadf41ebe7d2e9f0d628c2/family1 2023-03-11 00:54:22,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testScannerOnBulkLoadRefHFiles__9i4dlks1ucknv4keh2f08u4df9ab4cf0l58ppfaai799b432nllt2b3a3al62vt5/family1/e6176af8b4f94f739603bf55aa33c914 into 2b37f493ceeadf41ebe7d2e9f0d628c2/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9cb4e0d644ca4b079e90450e60114d29_SeqId_12_) 2023-03-11 00:54:22,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testScannerOnBulkLoadRefHFiles__9i4dlks1ucknv4keh2f08u4df9ab4cf0l58ppfaai799b432nllt2b3a3al62vt5/family1/e6176af8b4f94f739603bf55aa33c914 2023-03-11 00:54:22,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 00:54:22,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 00:54:22,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 2b37f493ceeadf41ebe7d2e9f0d628c2/family1 is initiating minor compaction (all files) 2023-03-11 00:54:22,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7b3329e0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:22,593 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2b37f493ceeadf41ebe7d2e9f0d628c2/family1 in testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:54:22,594 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/5a5f0268c05147acaf003087a9a0c657, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9600cca02bdb488ebf33e855f71b34db, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9cb4e0d644ca4b079e90450e60114d29_SeqId_12_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/.tmp, totalSize=15.1 K 2023-03-11 00:54:22,594 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 5a5f0268c05147acaf003087a9a0c657, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496059733 2023-03-11 00:54:22,595 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 9600cca02bdb488ebf33e855f71b34db, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496059733 2023-03-11 00:54:22,595 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-11 00:54:22,595 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 9cb4e0d644ca4b079e90450e60114d29_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496059733 2023-03-11 00:54:22,596 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:22,598 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023031153fc83d97c414e3d9bd23241e895f6f3 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023031153fc83d97c414e3d9bd23241e895f6f3 2023-03-11 00:54:22,599 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303118b08fa688bb545dd9812e936060c9f28 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303118b08fa688bb545dd9812e936060c9f28 2023-03-11 00:54:22,599 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-11 00:54:22,599 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230311' 2023-03-11 00:54:22,599 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230311 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-11 00:54:22,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-11 00:54:22,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:22,600 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-11 00:54:22,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 900 msec 2023-03-11 00:54:22,609 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2b37f493ceeadf41ebe7d2e9f0d628c2#family1#compaction#37 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:54:22,634 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=245 (was 260), OpenFileDescriptor=590 (was 636), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 244), ProcessCount=170 (was 170), AvailableMemoryMB=5507 (was 5464) - AvailableMemoryMB LEAK? - 2023-03-11 00:54:22,644 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=245, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=170, AvailableMemoryMB=5506 2023-03-11 00:54:22,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 00:54:22,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:22,649 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:54:22,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-11 00:54:22,649 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:54:22,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 00:54:22,651 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3 2023-03-11 00:54:22,651 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3 empty. 2023-03-11 00:54:22,652 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3 2023-03-11 00:54:22,652 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-11 00:54:22,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 00:54:22,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 00:54:23,060 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-11 00:54:23,061 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 327735cd40a8e23c9c8cdf4047ec37a3, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:54:23,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 00:54:23,467 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:23,467 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 327735cd40a8e23c9c8cdf4047ec37a3, disabling compactions & flushes 2023-03-11 00:54:23,467 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:23,467 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:23,467 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. after waiting 0 ms 2023-03-11 00:54:23,467 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:23,467 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:23,467 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:23,469 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:54:23,470 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678496063470"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496063470"}]},"ts":"1678496063470"} 2023-03-11 00:54:23,473 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 00:54:23,473 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:54:23,474 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496063473"}]},"ts":"1678496063473"} 2023-03-11 00:54:23,475 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-11 00:54:23,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=327735cd40a8e23c9c8cdf4047ec37a3, ASSIGN}] 2023-03-11 00:54:23,481 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=327735cd40a8e23c9c8cdf4047ec37a3, ASSIGN 2023-03-11 00:54:23,481 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=327735cd40a8e23c9c8cdf4047ec37a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:54:23,633 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=327735cd40a8e23c9c8cdf4047ec37a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:23,633 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678496063633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496063633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496063633"}]},"ts":"1678496063633"} 2023-03-11 00:54:23,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 327735cd40a8e23c9c8cdf4047ec37a3, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:23,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 00:54:23,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:23,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 327735cd40a8e23c9c8cdf4047ec37a3, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:54:23,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 327735cd40a8e23c9c8cdf4047ec37a3 2023-03-11 00:54:23,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:23,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 327735cd40a8e23c9c8cdf4047ec37a3 2023-03-11 00:54:23,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 327735cd40a8e23c9c8cdf4047ec37a3 2023-03-11 00:54:23,792 INFO [StoreOpener-327735cd40a8e23c9c8cdf4047ec37a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 327735cd40a8e23c9c8cdf4047ec37a3 2023-03-11 00:54:23,793 DEBUG [StoreOpener-327735cd40a8e23c9c8cdf4047ec37a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1 2023-03-11 00:54:23,793 DEBUG [StoreOpener-327735cd40a8e23c9c8cdf4047ec37a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1 2023-03-11 00:54:23,794 INFO [StoreOpener-327735cd40a8e23c9c8cdf4047ec37a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 327735cd40a8e23c9c8cdf4047ec37a3 columnFamilyName family1 2023-03-11 00:54:23,795 INFO [StoreOpener-327735cd40a8e23c9c8cdf4047ec37a3-1] regionserver.HStore(310): Store=327735cd40a8e23c9c8cdf4047ec37a3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:23,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3 2023-03-11 00:54:23,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3 2023-03-11 00:54:23,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 327735cd40a8e23c9c8cdf4047ec37a3 2023-03-11 00:54:23,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:54:23,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 327735cd40a8e23c9c8cdf4047ec37a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67547536, jitterRate=0.006536722183227539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:54:23,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:23,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3., pid=37, masterSystemTime=1678496063786 2023-03-11 00:54:23,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:23,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:23,804 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=327735cd40a8e23c9c8cdf4047ec37a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:23,805 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678496063804"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496063804"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496063804"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496063804"}]},"ts":"1678496063804"} 2023-03-11 00:54:23,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-11 00:54:23,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 327735cd40a8e23c9c8cdf4047ec37a3, server=jenkins-hbase4.apache.org,38819,1678496016129 in 171 msec 2023-03-11 00:54:23,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-11 00:54:23,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=327735cd40a8e23c9c8cdf4047ec37a3, ASSIGN in 329 msec 2023-03-11 00:54:23,810 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:54:23,811 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496063811"}]},"ts":"1678496063811"} 2023-03-11 00:54:23,812 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-11 00:54:23,815 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:54:23,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1690 sec 2023-03-11 00:54:23,830 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/.tmp/family1/7003f538359a4336a481d269e8dc27f1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/7003f538359a4336a481d269e8dc27f1 2023-03-11 00:54:23,835 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2b37f493ceeadf41ebe7d2e9f0d628c2/family1 of 2b37f493ceeadf41ebe7d2e9f0d628c2 into 7003f538359a4336a481d269e8dc27f1(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:54:23,835 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2b37f493ceeadf41ebe7d2e9f0d628c2: 2023-03-11 00:54:23,836 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1678496062593; duration=1sec 2023-03-11 00:54:23,836 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:23,847 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/5a5f0268c05147acaf003087a9a0c657, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9600cca02bdb488ebf33e855f71b34db, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9cb4e0d644ca4b079e90450e60114d29_SeqId_12_] to archive 2023-03-11 00:54:23,848 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:23,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/5a5f0268c05147acaf003087a9a0c657 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/5a5f0268c05147acaf003087a9a0c657 2023-03-11 00:54:23,851 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9600cca02bdb488ebf33e855f71b34db to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9600cca02bdb488ebf33e855f71b34db 2023-03-11 00:54:23,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9cb4e0d644ca4b079e90450e60114d29_SeqId_12_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/family1/9cb4e0d644ca4b079e90450e60114d29_SeqId_12_ 2023-03-11 00:54:24,316 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:54:24,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 00:54:24,755 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-11 00:54:24,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:24,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:24,787 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:24,787 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:24,787 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:24,787 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:24,788 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:24,788 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:24,789 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:24,789 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:24,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:24,789 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:24,789 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:24,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:24,790 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:24,790 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:24,790 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:24,790 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:24,791 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:24,791 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:24,791 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:24,791 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. started... 2023-03-11 00:54:24,791 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 327735cd40a8e23c9c8cdf4047ec37a3 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 00:54:25,212 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304af79d5fd84245e0ba1163f95467f37c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511304af79d5fd84245e0ba1163f95467f37c 2023-03-11 00:54:25,414 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:25,616 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/c54ac6c6c8fc4895855f2c73dbf6cf22 2023-03-11 00:54:25,621 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/c54ac6c6c8fc4895855f2c73dbf6cf22 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/c54ac6c6c8fc4895855f2c73dbf6cf22 2023-03-11 00:54:25,626 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/c54ac6c6c8fc4895855f2c73dbf6cf22, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-11 00:54:25,626 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 327735cd40a8e23c9c8cdf4047ec37a3 in 835ms, sequenceid=5, compaction requested=false 2023-03-11 00:54:25,627 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:25,627 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:25,627 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:25,627 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:25,627 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,627 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:25,627 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:25,630 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,630 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:25,630 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,630 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:25,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:25,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54c09864[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:25,632 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:25,632 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,633 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,633 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:25,633 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:25,633 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:25,633 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,633 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:25,635 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:25,635 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,635 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:25,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:25,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:25,635 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:25,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:25,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:25,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:25,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:25,637 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:25,637 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:25,637 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:25,637 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,637 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:25,638 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,638 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:25,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:25,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,638 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:25,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:25,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:25,639 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:25,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:25,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,640 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:25,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,643 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,643 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:25,643 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:25,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:25,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:25,644 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:25,644 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,643 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:25,644 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:25,644 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,644 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,644 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:25,644 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:25,644 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:25,744 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:25,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:25,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:25,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:25,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,751 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:25,751 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:25,751 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:25,751 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:25,751 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,751 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,753 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:25,753 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:25,753 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:25,753 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:25,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:25,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,754 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,754 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:25,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:25,755 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:25,755 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:25,755 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:25,755 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:25,755 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:25,755 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:25,755 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. started... 2023-03-11 00:54:25,755 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 327735cd40a8e23c9c8cdf4047ec37a3 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 00:54:26,170 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286221d283e50c4cbdbf93485012ee0bfc to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511286221d283e50c4cbdbf93485012ee0bfc 2023-03-11 00:54:26,576 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/2a1100aa954f4637a9c2945f35295155 2023-03-11 00:54:26,581 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/2a1100aa954f4637a9c2945f35295155 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/2a1100aa954f4637a9c2945f35295155 2023-03-11 00:54:26,585 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/2a1100aa954f4637a9c2945f35295155, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 00:54:26,586 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 327735cd40a8e23c9c8cdf4047ec37a3 in 831ms, sequenceid=9, compaction requested=false 2023-03-11 00:54:26,586 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:26,586 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:26,586 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:26,586 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:26,586 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,586 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:26,586 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:26,588 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,588 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:26,588 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,588 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:26,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:26,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@784e539a[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:26,589 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:26,589 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,594 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,594 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:26,594 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:26,594 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:26,594 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,594 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:26,595 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:26,595 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,595 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:26,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:26,595 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:26,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:26,598 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:26,598 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:26,598 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:26,598 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,598 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:26,599 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,599 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:26,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,599 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:26,600 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:26,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,601 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,603 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,603 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,603 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,603 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:26,603 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:26,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:26,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:26,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:26,603 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:26,603 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:26,603 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,603 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,603 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,603 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:26,604 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:26,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:26,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:26,704 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:26,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:26,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:26,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:26,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,710 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:26,710 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:26,710 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:26,710 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:26,710 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,711 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,713 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:26,713 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:26,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:26,713 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:26,714 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:26,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:26,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,714 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,714 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:26,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:26,714 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:26,714 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:26,715 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:26,715 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:26,715 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:26,715 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:26,715 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. started... 2023-03-11 00:54:26,715 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 327735cd40a8e23c9c8cdf4047ec37a3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:27,127 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201cea97dee47744c3e9a3dde33dda164a9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201cea97dee47744c3e9a3dde33dda164a9 2023-03-11 00:54:27,533 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/6fcf1d79ca55497c88befa217eb70e94 2023-03-11 00:54:27,538 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/6fcf1d79ca55497c88befa217eb70e94 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fcf1d79ca55497c88befa217eb70e94 2023-03-11 00:54:27,542 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fcf1d79ca55497c88befa217eb70e94, entries=1, sequenceid=13, filesize=4.9 K 2023-03-11 00:54:27,543 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 327735cd40a8e23c9c8cdf4047ec37a3 in 828ms, sequenceid=13, compaction requested=true 2023-03-11 00:54:27,543 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:27,544 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:27,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:27,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:27,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:27,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:27,545 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:27,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:27,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:27,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39d709a4[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:27,547 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:27,547 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,548 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,548 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:27,548 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:27,548 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:27,548 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,548 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:27,549 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,549 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:27,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:27,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:27,549 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:27,550 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:27,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:27,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:27,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:27,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:27,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:27,551 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:27,551 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:27,551 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:27,552 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,552 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:27,554 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,554 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:27,554 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,554 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:27,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,556 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,558 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,558 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:27,558 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:27,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:27,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:27,558 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,558 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:27,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:27,558 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:27,558 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:27,559 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:27,558 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:27,559 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,559 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,559 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,659 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:27,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:27,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:27,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:27,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,665 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:27,665 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:27,665 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:27,665 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:27,666 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,666 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,667 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,667 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:27,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:27,667 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:27,667 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,668 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,668 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:27,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:27,668 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:27,668 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:27,668 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:27,668 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:27,668 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:27,668 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:27,669 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. started... 2023-03-11 00:54:27,669 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 327735cd40a8e23c9c8cdf4047ec37a3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:28,083 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055044b59330004003bffe195ad19769e8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055044b59330004003bffe195ad19769e8 2023-03-11 00:54:28,490 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/32815286061449c8b71a20dc4ebef43a 2023-03-11 00:54:28,495 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/32815286061449c8b71a20dc4ebef43a as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/32815286061449c8b71a20dc4ebef43a 2023-03-11 00:54:28,500 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/32815286061449c8b71a20dc4ebef43a, entries=1, sequenceid=17, filesize=4.9 K 2023-03-11 00:54:28,501 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 327735cd40a8e23c9c8cdf4047ec37a3 in 832ms, sequenceid=17, compaction requested=true 2023-03-11 00:54:28,501 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:28,501 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:28,501 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:28,501 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:28,501 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,501 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:28,501 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:28,503 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,503 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:28,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:28,503 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,503 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:28,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:28,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:28,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:28,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:28,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c1279de[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:28,504 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:28,505 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,506 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,506 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:28,506 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:28,506 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:28,506 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,506 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:28,508 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,508 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:28,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:28,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:28,508 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:28,508 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:28,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:28,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:28,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:28,510 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:28,510 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:28,510 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:28,510 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,510 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:28,511 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,511 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:28,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,511 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:28,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:28,512 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:28,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,513 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:28,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,515 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:28,515 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,515 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:28,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:28,515 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:28,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:28,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:28,515 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:28,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:28,515 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,516 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:28,516 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,516 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:28,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:28,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:28,516 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,516 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,516 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,616 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:28,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:28,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:28,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:28,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,623 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:28,623 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:28,623 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:28,623 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:28,623 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,623 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,626 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,626 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:28,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:28,626 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:28,627 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:28,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:28,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,627 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,628 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:28,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:28,628 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:28,628 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:28,628 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:28,628 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:28,628 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:28,628 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:28,628 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. started... 2023-03-11 00:54:28,628 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 327735cd40a8e23c9c8cdf4047ec37a3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:29,041 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f46accec6fb64ebf83743be413b13c04 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f46accec6fb64ebf83743be413b13c04 2023-03-11 00:54:29,292 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:54:29,447 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/83aac4cd7cd44a0f98f4fbf8bbc7c33b 2023-03-11 00:54:29,452 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/83aac4cd7cd44a0f98f4fbf8bbc7c33b as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/83aac4cd7cd44a0f98f4fbf8bbc7c33b 2023-03-11 00:54:29,456 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/83aac4cd7cd44a0f98f4fbf8bbc7c33b, entries=1, sequenceid=21, filesize=4.9 K 2023-03-11 00:54:29,457 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 327735cd40a8e23c9c8cdf4047ec37a3 in 829ms, sequenceid=21, compaction requested=true 2023-03-11 00:54:29,457 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:29,457 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:29,457 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:29,457 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:29,457 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,457 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:29,457 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,462 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:29,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:29,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:29,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:29,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:29,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:29,464 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:29,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c41d380[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:29,464 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,465 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,465 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:29,465 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:29,465 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,465 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:29,465 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:29,467 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:29,467 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,468 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:29,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:29,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:29,468 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:29,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:29,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:29,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:29,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:29,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:29,470 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:29,470 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:29,470 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:29,470 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,470 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:29,471 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,471 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:29,471 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,472 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:29,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,473 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:29,475 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:29,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:29,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:29,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:29,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:29,475 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:29,576 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:29,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:29,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:29,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:29,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,582 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:29,582 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:29,582 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:29,582 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:29,582 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,582 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,585 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,585 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:29,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:29,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:29,585 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:29,585 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:29,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:29,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,586 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,586 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:29,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:29,586 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:29,586 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:29,586 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:29,586 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:29,586 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:29,586 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:29,586 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. started... 2023-03-11 00:54:29,586 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 327735cd40a8e23c9c8cdf4047ec37a3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:29,999 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123105230f0dc7a349c5bf10a13914b9042c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123105230f0dc7a349c5bf10a13914b9042c 2023-03-11 00:54:30,405 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/6fd8bb6e82ad454cbfb4a7eb0206464d 2023-03-11 00:54:30,410 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/6fd8bb6e82ad454cbfb4a7eb0206464d as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fd8bb6e82ad454cbfb4a7eb0206464d 2023-03-11 00:54:30,415 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fd8bb6e82ad454cbfb4a7eb0206464d, entries=1, sequenceid=25, filesize=4.9 K 2023-03-11 00:54:30,416 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 327735cd40a8e23c9c8cdf4047ec37a3 in 829ms, sequenceid=25, compaction requested=true 2023-03-11 00:54:30,416 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:30,416 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:30,417 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,417 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:30,418 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:30,418 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56199911[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:30,419 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:30,419 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,420 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,420 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:30,420 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,420 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:30,421 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:30,422 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:30,422 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:30,422 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,422 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:30,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:30,424 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:30,424 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:30,424 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:30,424 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,424 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:30,426 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,426 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,426 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:30,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:30,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:30,427 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,428 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,430 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,430 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:30,430 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:30,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:30,430 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:30,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:30,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:30,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:30,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:30,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:30,430 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,430 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:30,433 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,433 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,433 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,434 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,434 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:30,434 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:30,534 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:30,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:30,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:30,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:30,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,540 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:30,540 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:30,540 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:30,540 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:30,541 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,541 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,542 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,542 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:30,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:30,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:30,542 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:30,542 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,543 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,543 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:30,543 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:30,543 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:30,543 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:30,543 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:30,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:30,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:30,544 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:30,544 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. started... 2023-03-11 00:54:30,544 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 327735cd40a8e23c9c8cdf4047ec37a3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:30,956 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101949e30591189498b84ab2993abc52076 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101949e30591189498b84ab2993abc52076 2023-03-11 00:54:31,362 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/ba06adc7de8f4df0b3ce0803db40d003 2023-03-11 00:54:31,367 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/ba06adc7de8f4df0b3ce0803db40d003 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/ba06adc7de8f4df0b3ce0803db40d003 2023-03-11 00:54:31,371 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/ba06adc7de8f4df0b3ce0803db40d003, entries=1, sequenceid=29, filesize=4.9 K 2023-03-11 00:54:31,372 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 327735cd40a8e23c9c8cdf4047ec37a3 in 828ms, sequenceid=29, compaction requested=true 2023-03-11 00:54:31,372 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:31,373 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:31,373 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:31,373 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:31,373 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,373 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:31,373 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:31,374 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,374 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:31,375 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,375 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:31,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:31,376 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:31,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5782205f[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:31,376 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,378 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:31,378 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,378 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:31,380 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:31,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:31,382 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:31,382 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:31,382 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:31,382 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,382 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:31,384 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,384 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,384 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:31,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:31,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:31,385 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,386 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:31,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,391 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,391 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:31,391 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:31,392 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:31,392 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,392 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:31,392 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:31,392 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:31,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:31,392 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,392 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:31,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:31,392 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:31,392 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:31,493 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:31,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:31,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:31,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:31,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,499 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:31,499 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:31,499 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:31,499 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:31,500 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,500 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,501 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:31,501 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:31,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:31,501 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:31,501 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:31,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:31,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,502 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,502 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:31,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:31,502 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:31,502 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:31,502 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:31,503 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:31,503 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:31,503 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:31,503 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. started... 2023-03-11 00:54:31,503 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 327735cd40a8e23c9c8cdf4047ec37a3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:31,916 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c1197e6399ac4f3a9acc334277fbc36e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c1197e6399ac4f3a9acc334277fbc36e 2023-03-11 00:54:32,322 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/5f88f219006c4740bd455d658819bab5 2023-03-11 00:54:32,328 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/5f88f219006c4740bd455d658819bab5 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/5f88f219006c4740bd455d658819bab5 2023-03-11 00:54:32,332 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/5f88f219006c4740bd455d658819bab5, entries=1, sequenceid=33, filesize=4.9 K 2023-03-11 00:54:32,333 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 327735cd40a8e23c9c8cdf4047ec37a3 in 830ms, sequenceid=33, compaction requested=true 2023-03-11 00:54:32,333 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:32,333 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:32,333 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:32,334 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:32,334 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,334 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:32,334 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,335 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:32,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,335 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:32,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:32,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:32,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:32,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:32,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48417ff8[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:32,337 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:32,337 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,338 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,338 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:32,338 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:32,338 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:32,338 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,338 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:32,340 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:32,340 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,340 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:32,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,340 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:32,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:32,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:32,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:32,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:32,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:32,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:32,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:32,342 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:32,342 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:32,343 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:32,343 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,343 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:32,344 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,344 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:32,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,344 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:32,345 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,346 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,348 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,348 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:32,348 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:32,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:32,348 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:32,348 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:32,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:32,348 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:32,348 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:32,349 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,349 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:32,349 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:32,349 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,349 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:32,449 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:32,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:32,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:32,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:32,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,456 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:32,456 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:32,456 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:32,456 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:32,457 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,457 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,458 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,458 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:32,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:32,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:32,458 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:32,458 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:32,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:32,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,459 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,459 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:32,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:32,460 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:32,460 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:32,460 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:32,460 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:32,460 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:32,460 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:32,460 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. started... 2023-03-11 00:54:32,460 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 327735cd40a8e23c9c8cdf4047ec37a3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:32,874 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078dd7d3f7494941508c009b4f711fcfcb to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509078dd7d3f7494941508c009b4f711fcfcb 2023-03-11 00:54:33,280 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/7afa9108628348b9973f35150ef1937e 2023-03-11 00:54:33,286 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/7afa9108628348b9973f35150ef1937e as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/7afa9108628348b9973f35150ef1937e 2023-03-11 00:54:33,290 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/7afa9108628348b9973f35150ef1937e, entries=1, sequenceid=37, filesize=4.9 K 2023-03-11 00:54:33,290 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 327735cd40a8e23c9c8cdf4047ec37a3 in 830ms, sequenceid=37, compaction requested=true 2023-03-11 00:54:33,291 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:33,291 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:33,291 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:33,291 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:33,291 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,291 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:33,291 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:33,293 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,293 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:33,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:33,293 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,293 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:33,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:33,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a4e78a3[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:33,295 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:33,295 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,296 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,296 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:33,296 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:33,296 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,297 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:33,296 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:33,298 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:33,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:33,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:33,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:33,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:33,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:33,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:33,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:33,300 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:33,300 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:33,300 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:33,300 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,300 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:33,302 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,302 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,302 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:33,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:33,302 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,303 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,310 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,310 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:33,310 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:33,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:33,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:33,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:33,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:33,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:33,311 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:33,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,311 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:33,311 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:33,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:33,311 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:33,411 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:33,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:33,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:33,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:33,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,418 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:33,418 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:33,418 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 00:54:33,418 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 00:54:33,419 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,419 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,420 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:33,420 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:33,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:33,420 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:33,420 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,421 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,421 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 00:54:33,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:33,421 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 00:54:33,421 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:33,422 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 00:54:33,422 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:33,422 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:33,422 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:33,422 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. started... 2023-03-11 00:54:33,422 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 327735cd40a8e23c9c8cdf4047ec37a3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:33,834 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201ea931e1d0054c52b84480e6cb99e7a7 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511201ea931e1d0054c52b84480e6cb99e7a7 2023-03-11 00:54:34,240 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/c48df64dd20f4f96b7d85efcd920d428 2023-03-11 00:54:34,244 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/c48df64dd20f4f96b7d85efcd920d428 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/c48df64dd20f4f96b7d85efcd920d428 2023-03-11 00:54:34,248 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/c48df64dd20f4f96b7d85efcd920d428, entries=1, sequenceid=41, filesize=4.9 K 2023-03-11 00:54:34,249 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 327735cd40a8e23c9c8cdf4047ec37a3 in 827ms, sequenceid=41, compaction requested=true 2023-03-11 00:54:34,249 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:34,249 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:34,249 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:34,249 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:34,249 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,249 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 00:54:34,249 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 00:54:34,251 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,251 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:34,251 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,252 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:34,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 00:54:34,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5abea[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:34,253 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 00:54:34,253 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,254 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,254 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 00:54:34,254 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,254 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:34,254 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 00:54:34,254 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:34,256 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,256 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 00:54:34,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:34,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:34,256 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:34,257 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 00:54:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:34,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:54:34,259 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 00:54:34,259 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:34,259 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:34,259 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,259 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:34,261 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,261 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,261 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:34,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:34,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:34,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,262 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:34,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:34,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:34,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:34,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,263 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:34,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,267 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,267 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,267 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,267 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:34,267 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:34,268 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:34,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 00:54:34,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:34,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:34,268 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:34,268 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 00:54:34,268 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,268 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:34,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:34,268 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:34,268 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:34,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:34,368 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:34,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:34,371 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-11 00:54:34,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:54:34,373 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:54:34,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:34,374 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496674374 2023-03-11 00:54:34,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:54:34,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-11 00:54:34,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:34,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x3d31b165 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:54:34,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4400ac06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:54:34,383 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:34,825 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c3a22498e1e04d718919cc914b47910a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c3a22498e1e04d718919cc914b47910a 2023-03-11 00:54:34,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:34,839 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:54:34,840 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51544, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:54:34,847 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:54:34,848 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:54:34,856 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ebf54c46b9ae4a08841739b83a9d936e first=Optional[r3] last=Optional[r6] 2023-03-11 00:54:34,857 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ebf54c46b9ae4a08841739b83a9d936e}] 2023-03-11 00:54:34,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ebf54c46b9ae4a08841739b83a9d936e for inclusion in 327735cd40a8e23c9c8cdf4047ec37a3/family1 2023-03-11 00:54:34,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-11 00:54:34,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:54:34,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:34,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ebf54c46b9ae4a08841739b83a9d936e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qq1pq0nbus3tc7251bl5c8uq570s4mh5c2e3egc950lbqd1app4ga59l47gb4u7b/family1/ebf54c46b9ae4a08841739b83a9d936e 2023-03-11 00:54:34,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qq1pq0nbus3tc7251bl5c8uq570s4mh5c2e3egc950lbqd1app4ga59l47gb4u7b/family1/ebf54c46b9ae4a08841739b83a9d936e as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/b5039569797e4182a3e4c6f017bb4280_SeqId_44_ 2023-03-11 00:54:34,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qq1pq0nbus3tc7251bl5c8uq570s4mh5c2e3egc950lbqd1app4ga59l47gb4u7b/family1/ebf54c46b9ae4a08841739b83a9d936e into 327735cd40a8e23c9c8cdf4047ec37a3/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/b5039569797e4182a3e4c6f017bb4280_SeqId_44_ - updating store file list. 2023-03-11 00:54:34,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/b5039569797e4182a3e4c6f017bb4280_SeqId_44_ into 327735cd40a8e23c9c8cdf4047ec37a3/family1 2023-03-11 00:54:34,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qq1pq0nbus3tc7251bl5c8uq570s4mh5c2e3egc950lbqd1app4ga59l47gb4u7b/family1/ebf54c46b9ae4a08841739b83a9d936e into 327735cd40a8e23c9c8cdf4047ec37a3/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/b5039569797e4182a3e4c6f017bb4280_SeqId_44_) 2023-03-11 00:54:34,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qq1pq0nbus3tc7251bl5c8uq570s4mh5c2e3egc950lbqd1app4ga59l47gb4u7b/family1/ebf54c46b9ae4a08841739b83a9d936e 2023-03-11 00:54:34,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 00:54:34,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 00:54:34,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 327735cd40a8e23c9c8cdf4047ec37a3/family1 is initiating minor compaction 2023-03-11 00:54:34,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@623b966b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:34,874 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 327735cd40a8e23c9c8cdf4047ec37a3/family1 in testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:54:34,874 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/2a1100aa954f4637a9c2945f35295155, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fcf1d79ca55497c88befa217eb70e94, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/32815286061449c8b71a20dc4ebef43a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/83aac4cd7cd44a0f98f4fbf8bbc7c33b, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fd8bb6e82ad454cbfb4a7eb0206464d, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/ba06adc7de8f4df0b3ce0803db40d003, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/5f88f219006c4740bd455d658819bab5, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/7afa9108628348b9973f35150ef1937e, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/c48df64dd20f4f96b7d85efcd920d428, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/b5039569797e4182a3e4c6f017bb4280_SeqId_44_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp, totalSize=50.0 K 2023-03-11 00:54:34,874 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 2a1100aa954f4637a9c2945f35295155, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 00:54:34,875 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 6fcf1d79ca55497c88befa217eb70e94, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 00:54:34,875 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 32815286061449c8b71a20dc4ebef43a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 00:54:34,875 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 83aac4cd7cd44a0f98f4fbf8bbc7c33b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 00:54:34,875 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 6fd8bb6e82ad454cbfb4a7eb0206464d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 00:54:34,875 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting ba06adc7de8f4df0b3ce0803db40d003, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 00:54:34,875 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 5f88f219006c4740bd455d658819bab5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 00:54:34,875 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 7afa9108628348b9973f35150ef1937e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 00:54:34,875 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting c48df64dd20f4f96b7d85efcd920d428, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 00:54:34,875 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting b5039569797e4182a3e4c6f017bb4280_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 00:54:34,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:34,877 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:34,878 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f46accec6fb64ebf83743be413b13c04 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f46accec6fb64ebf83743be413b13c04 2023-03-11 00:54:34,880 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123105230f0dc7a349c5bf10a13914b9042c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123105230f0dc7a349c5bf10a13914b9042c 2023-03-11 00:54:34,881 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101949e30591189498b84ab2993abc52076 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101949e30591189498b84ab2993abc52076 2023-03-11 00:54:34,882 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c1197e6399ac4f3a9acc334277fbc36e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c1197e6399ac4f3a9acc334277fbc36e 2023-03-11 00:54:34,883 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-11 00:54:34,883 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-11 00:54:34,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:34,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:34,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:34,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:34,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:34,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:34,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:34,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:34,915 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 327735cd40a8e23c9c8cdf4047ec37a3#family1#compaction#48 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:54:34,941 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a25076ec08e6455890329421c1dd2743 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205a25076ec08e6455890329421c1dd2743 2023-03-11 00:54:34,942 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:34,966 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/46e826e4bd99419886a5be750ee8cb39 first=Optional[r00] last=Optional[r2] 2023-03-11 00:54:34,967 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/46e826e4bd99419886a5be750ee8cb39}] 2023-03-11 00:54:34,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/46e826e4bd99419886a5be750ee8cb39 for inclusion in 327735cd40a8e23c9c8cdf4047ec37a3/family1 2023-03-11 00:54:34,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-11 00:54:34,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:54:34,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:34,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/46e826e4bd99419886a5be750ee8cb39 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyPolicy__opm07f84d02vtc9h180rchgf5mtpokrte39ndrkhq3r6n2liohs798g6qjn621a3/family1/46e826e4bd99419886a5be750ee8cb39 2023-03-11 00:54:34,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyPolicy__opm07f84d02vtc9h180rchgf5mtpokrte39ndrkhq3r6n2liohs798g6qjn621a3/family1/46e826e4bd99419886a5be750ee8cb39 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/0e144cef80ab43a192c3ce77cfcbf360_SeqId_46_ 2023-03-11 00:54:34,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyPolicy__opm07f84d02vtc9h180rchgf5mtpokrte39ndrkhq3r6n2liohs798g6qjn621a3/family1/46e826e4bd99419886a5be750ee8cb39 into 327735cd40a8e23c9c8cdf4047ec37a3/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/0e144cef80ab43a192c3ce77cfcbf360_SeqId_46_ - updating store file list. 2023-03-11 00:54:34,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/0e144cef80ab43a192c3ce77cfcbf360_SeqId_46_ into 327735cd40a8e23c9c8cdf4047ec37a3/family1 2023-03-11 00:54:34,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyPolicy__opm07f84d02vtc9h180rchgf5mtpokrte39ndrkhq3r6n2liohs798g6qjn621a3/family1/46e826e4bd99419886a5be750ee8cb39 into 327735cd40a8e23c9c8cdf4047ec37a3/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/0e144cef80ab43a192c3ce77cfcbf360_SeqId_46_) 2023-03-11 00:54:34,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyPolicy__opm07f84d02vtc9h180rchgf5mtpokrte39ndrkhq3r6n2liohs798g6qjn621a3/family1/46e826e4bd99419886a5be750ee8cb39 2023-03-11 00:54:34,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:34,982 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:34,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511304af79d5fd84245e0ba1163f95467f37c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511304af79d5fd84245e0ba1163f95467f37c 2023-03-11 00:54:34,985 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201cea97dee47744c3e9a3dde33dda164a9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201cea97dee47744c3e9a3dde33dda164a9 2023-03-11 00:54:34,986 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055044b59330004003bffe195ad19769e8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055044b59330004003bffe195ad19769e8 2023-03-11 00:54:34,986 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-11 00:54:34,986 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-11 00:54:34,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 00:54:34,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 00:54:34,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:34,988 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:54:34,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 617 msec 2023-03-11 00:54:35,092 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=257 (was 245) - Thread LEAK? -, OpenFileDescriptor=629 (was 590) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=236 (was 231) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=5559 (was 5506) - AvailableMemoryMB LEAK? - 2023-03-11 00:54:35,107 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=257, OpenFileDescriptor=629, MaxFileDescriptor=60000, SystemLoadAverage=236, ProcessCount=170, AvailableMemoryMB=5559 2023-03-11 00:54:35,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 00:54:35,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:35,111 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:54:35,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-11 00:54:35,112 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:54:35,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 00:54:35,113 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:35,114 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f empty. 2023-03-11 00:54:35,114 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:35,114 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-11 00:54:35,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 00:54:35,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 00:54:35,522 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-11 00:54:35,523 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2821f2e121861947edb0825c770e8e9f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:54:35,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 00:54:35,735 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/.tmp/family1/4bd0d018229e40e78a37a20109316c91 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/4bd0d018229e40e78a37a20109316c91 2023-03-11 00:54:35,740 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 327735cd40a8e23c9c8cdf4047ec37a3/family1 of 327735cd40a8e23c9c8cdf4047ec37a3 into 4bd0d018229e40e78a37a20109316c91(size=6.6 K), total size for store is 337.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:54:35,740 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:54:35,740 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678496074874; duration=0sec 2023-03-11 00:54:35,740 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:35,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/2a1100aa954f4637a9c2945f35295155, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fcf1d79ca55497c88befa217eb70e94, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/32815286061449c8b71a20dc4ebef43a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/83aac4cd7cd44a0f98f4fbf8bbc7c33b, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fd8bb6e82ad454cbfb4a7eb0206464d, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/ba06adc7de8f4df0b3ce0803db40d003, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/5f88f219006c4740bd455d658819bab5, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/7afa9108628348b9973f35150ef1937e, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/c48df64dd20f4f96b7d85efcd920d428, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/b5039569797e4182a3e4c6f017bb4280_SeqId_44_] to archive 2023-03-11 00:54:35,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:35,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/2a1100aa954f4637a9c2945f35295155 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/2a1100aa954f4637a9c2945f35295155 2023-03-11 00:54:35,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fcf1d79ca55497c88befa217eb70e94 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fcf1d79ca55497c88befa217eb70e94 2023-03-11 00:54:35,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/32815286061449c8b71a20dc4ebef43a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/32815286061449c8b71a20dc4ebef43a 2023-03-11 00:54:35,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/83aac4cd7cd44a0f98f4fbf8bbc7c33b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/83aac4cd7cd44a0f98f4fbf8bbc7c33b 2023-03-11 00:54:35,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fd8bb6e82ad454cbfb4a7eb0206464d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/6fd8bb6e82ad454cbfb4a7eb0206464d 2023-03-11 00:54:35,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/ba06adc7de8f4df0b3ce0803db40d003 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/ba06adc7de8f4df0b3ce0803db40d003 2023-03-11 00:54:35,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/5f88f219006c4740bd455d658819bab5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/5f88f219006c4740bd455d658819bab5 2023-03-11 00:54:35,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/7afa9108628348b9973f35150ef1937e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/7afa9108628348b9973f35150ef1937e 2023-03-11 00:54:35,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/c48df64dd20f4f96b7d85efcd920d428 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/c48df64dd20f4f96b7d85efcd920d428 2023-03-11 00:54:35,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/b5039569797e4182a3e4c6f017bb4280_SeqId_44_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/family1/b5039569797e4182a3e4c6f017bb4280_SeqId_44_ 2023-03-11 00:54:35,929 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:35,930 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 2821f2e121861947edb0825c770e8e9f, disabling compactions & flushes 2023-03-11 00:54:35,930 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:35,930 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:35,930 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. after waiting 0 ms 2023-03-11 00:54:35,930 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:35,930 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:35,930 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:35,932 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:54:35,933 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496075933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496075933"}]},"ts":"1678496075933"} 2023-03-11 00:54:35,935 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 00:54:35,935 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:54:35,935 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496075935"}]},"ts":"1678496075935"} 2023-03-11 00:54:35,936 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-11 00:54:35,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, ASSIGN}] 2023-03-11 00:54:35,941 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, ASSIGN 2023-03-11 00:54:35,942 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:54:36,093 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=2821f2e121861947edb0825c770e8e9f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:36,093 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496076093"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496076093"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496076093"}]},"ts":"1678496076093"} 2023-03-11 00:54:36,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 2821f2e121861947edb0825c770e8e9f, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:36,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 00:54:36,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:36,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2821f2e121861947edb0825c770e8e9f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:54:36,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:36,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:36,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:36,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:36,251 INFO [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:36,252 DEBUG [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:36,252 DEBUG [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:36,253 INFO [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2821f2e121861947edb0825c770e8e9f columnFamilyName family1 2023-03-11 00:54:36,254 INFO [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] regionserver.HStore(310): Store=2821f2e121861947edb0825c770e8e9f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:36,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:36,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:36,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:36,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:54:36,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2821f2e121861947edb0825c770e8e9f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69051818, jitterRate=0.02895227074623108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:54:36,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:36,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f., pid=41, masterSystemTime=1678496076247 2023-03-11 00:54:36,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:36,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:36,262 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=2821f2e121861947edb0825c770e8e9f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:36,262 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496076261"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496076261"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496076261"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496076261"}]},"ts":"1678496076261"} 2023-03-11 00:54:36,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-11 00:54:36,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 2821f2e121861947edb0825c770e8e9f, server=jenkins-hbase4.apache.org,38819,1678496016129 in 168 msec 2023-03-11 00:54:36,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-11 00:54:36,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, ASSIGN in 326 msec 2023-03-11 00:54:36,267 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:54:36,267 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496076267"}]},"ts":"1678496076267"} 2023-03-11 00:54:36,268 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-11 00:54:36,271 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:54:36,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1620 sec 2023-03-11 00:54:37,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 00:54:37,217 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-11 00:54:37,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:37,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:37,241 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:37,241 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:37,241 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 00:54:37,241 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 00:54:37,241 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:37,242 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:37,243 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:37,243 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:37,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:37,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:37,243 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:37,243 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:37,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:37,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:37,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:37,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:37,244 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:37,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:37,244 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 00:54:37,245 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:37,245 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 00:54:37,247 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:37,247 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:37,247 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:37,247 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. started... 2023-03-11 00:54:37,248 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2821f2e121861947edb0825c770e8e9f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 00:54:37,416 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:37,434 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-11 00:54:37,669 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301b1964cef098414fb89ba86dbaf1ff66 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511301b1964cef098414fb89ba86dbaf1ff66 2023-03-11 00:54:38,072 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/22ca9f80dbd844c7b925fededf736e08 2023-03-11 00:54:38,078 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/22ca9f80dbd844c7b925fededf736e08 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/22ca9f80dbd844c7b925fededf736e08 2023-03-11 00:54:38,082 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/22ca9f80dbd844c7b925fededf736e08, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-11 00:54:38,083 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 2821f2e121861947edb0825c770e8e9f in 835ms, sequenceid=5, compaction requested=false 2023-03-11 00:54:38,084 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:38,084 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:38,084 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:38,084 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:38,084 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,084 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 00:54:38,084 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 00:54:38,089 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,089 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:38,089 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,089 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:38,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 00:54:38,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46c3f36d[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:38,090 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 00:54:38,091 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,092 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,092 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 00:54:38,092 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 00:54:38,092 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:38,092 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,092 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:38,094 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 00:54:38,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:38,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 00:54:38,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:38,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:38,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:38,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:38,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:38,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 00:54:38,096 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 00:54:38,096 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:38,096 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:38,096 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,096 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:38,097 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,097 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,098 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:38,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:38,098 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:38,099 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:38,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,101 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,101 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,101 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:38,102 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:38,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:38,102 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:38,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:38,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:38,102 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 00:54:38,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:38,102 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,102 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,102 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:38,102 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:38,102 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:38,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:38,102 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,202 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:38,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:38,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:38,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:38,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,209 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:38,209 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:38,209 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 00:54:38,209 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 00:54:38,210 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,210 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,211 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:38,211 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:38,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:38,211 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:38,211 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:38,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,212 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,212 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 00:54:38,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 00:54:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 00:54:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:38,212 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:38,212 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. started... 2023-03-11 00:54:38,213 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2821f2e121861947edb0825c770e8e9f 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 00:54:38,627 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fc5064219ba340f7848976f6d6b1bf72 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128fc5064219ba340f7848976f6d6b1bf72 2023-03-11 00:54:39,033 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/632048e748584a939cf097876fbb3cf0 2023-03-11 00:54:39,038 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/632048e748584a939cf097876fbb3cf0 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/632048e748584a939cf097876fbb3cf0 2023-03-11 00:54:39,042 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/632048e748584a939cf097876fbb3cf0, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 00:54:39,042 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 2821f2e121861947edb0825c770e8e9f in 829ms, sequenceid=9, compaction requested=false 2023-03-11 00:54:39,043 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:39,043 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 00:54:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 00:54:39,045 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,045 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:39,045 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,045 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:39,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 00:54:39,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53efaf2[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:39,046 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 00:54:39,046 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,047 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,048 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 00:54:39,048 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 00:54:39,048 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:39,048 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,048 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:39,050 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 00:54:39,050 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:39,050 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,050 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 00:54:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:39,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 00:54:39,053 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 00:54:39,053 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:39,053 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:39,053 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,053 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:39,054 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,054 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:39,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,054 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:39,055 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,056 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:39,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,061 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,061 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,061 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:39,061 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,061 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:39,061 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:39,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:39,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:39,061 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:39,061 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,062 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:39,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:39,062 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:39,062 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:39,062 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,162 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:39,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:39,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:39,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:39,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,169 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:39,169 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:39,169 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 00:54:39,169 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 00:54:39,169 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,169 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,172 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,172 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:39,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:39,172 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:39,172 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:39,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,173 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,173 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 00:54:39,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:39,173 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 00:54:39,173 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:39,173 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 00:54:39,173 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:39,173 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:39,173 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:39,174 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. started... 2023-03-11 00:54:39,174 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2821f2e121861947edb0825c770e8e9f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:39,587 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120153c04cc99f8145e9bbe0e344c402643b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120153c04cc99f8145e9bbe0e344c402643b 2023-03-11 00:54:39,993 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/191877288abb409dab0797dbeb01c1e9 2023-03-11 00:54:39,998 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/191877288abb409dab0797dbeb01c1e9 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/191877288abb409dab0797dbeb01c1e9 2023-03-11 00:54:40,002 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/191877288abb409dab0797dbeb01c1e9, entries=1, sequenceid=13, filesize=5.0 K 2023-03-11 00:54:40,003 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2821f2e121861947edb0825c770e8e9f in 829ms, sequenceid=13, compaction requested=true 2023-03-11 00:54:40,003 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:40,003 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:40,003 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:40,003 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:40,003 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,003 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 00:54:40,003 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 00:54:40,005 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,005 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:40,005 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,005 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:40,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 00:54:40,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c5c1196[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:40,007 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 00:54:40,007 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,008 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,008 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 00:54:40,008 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,008 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:40,008 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 00:54:40,008 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:40,009 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,010 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 00:54:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:40,010 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:40,010 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 00:54:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:40,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 00:54:40,012 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 00:54:40,012 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:40,012 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:40,012 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,012 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:40,014 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,014 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:40,015 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:40,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:40,015 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:40,016 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,018 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,018 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,018 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,018 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,018 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:40,018 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:40,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:40,018 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:40,018 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:40,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 00:54:40,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:40,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:40,018 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,019 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:40,019 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:40,019 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:40,119 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:40,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:40,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:40,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:40,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,126 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:40,126 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:40,126 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 00:54:40,126 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 00:54:40,126 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,126 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,127 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:40,127 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:40,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:40,128 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,128 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:40,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:40,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,128 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,129 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 00:54:40,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,129 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 00:54:40,129 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:40,129 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 00:54:40,129 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:40,129 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:40,129 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:40,129 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. started... 2023-03-11 00:54:40,129 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2821f2e121861947edb0825c770e8e9f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:40,542 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f2d04cf6973e4823a352dbd85e05684c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205f2d04cf6973e4823a352dbd85e05684c 2023-03-11 00:54:40,948 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/6ff51459ab744d0a93f0c7dfffc7e601 2023-03-11 00:54:40,954 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/6ff51459ab744d0a93f0c7dfffc7e601 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/6ff51459ab744d0a93f0c7dfffc7e601 2023-03-11 00:54:40,957 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/6ff51459ab744d0a93f0c7dfffc7e601, entries=1, sequenceid=17, filesize=5.0 K 2023-03-11 00:54:40,958 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2821f2e121861947edb0825c770e8e9f in 829ms, sequenceid=17, compaction requested=true 2023-03-11 00:54:40,959 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:40,959 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:40,959 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:40,959 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:40,959 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,959 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 00:54:40,959 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 00:54:40,961 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,961 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:40,962 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,962 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:40,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 00:54:40,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@412bad0c[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:40,963 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 00:54:40,963 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,964 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,965 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 00:54:40,965 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 00:54:40,965 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:40,965 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,965 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:40,966 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 00:54:40,966 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,966 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,966 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 00:54:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:40,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 00:54:40,969 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 00:54:40,969 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:40,969 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:40,969 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,969 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:40,970 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,970 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:40,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,970 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:40,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:40,971 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:40,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,972 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:40,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,976 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,976 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:40,976 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,976 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:40,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:40,976 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:40,976 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:40,976 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:40,976 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,976 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,976 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:40,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 00:54:40,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:40,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:40,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:40,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:40,977 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:40,977 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:41,077 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:41,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:41,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:41,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:41,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,083 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:41,083 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:41,083 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 00:54:41,083 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 00:54:41,084 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,084 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,085 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:41,085 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:41,085 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,085 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:41,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:41,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,086 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,086 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 00:54:41,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 00:54:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 00:54:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:41,087 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:41,087 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:41,087 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. started... 2023-03-11 00:54:41,087 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2821f2e121861947edb0825c770e8e9f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:41,501 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228de77e7134b044f51b8f750f2e449171a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228de77e7134b044f51b8f750f2e449171a 2023-03-11 00:54:41,791 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:54:41,907 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/332bbd6751f9401490961b0305dd5f52 2023-03-11 00:54:41,912 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/332bbd6751f9401490961b0305dd5f52 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/332bbd6751f9401490961b0305dd5f52 2023-03-11 00:54:41,915 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/332bbd6751f9401490961b0305dd5f52, entries=1, sequenceid=21, filesize=5.0 K 2023-03-11 00:54:41,916 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2821f2e121861947edb0825c770e8e9f in 829ms, sequenceid=21, compaction requested=true 2023-03-11 00:54:41,916 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:41,916 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:41,916 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:41,917 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:41,917 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,917 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 00:54:41,917 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 00:54:41,921 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,921 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:41,921 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,921 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:41,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 00:54:41,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@182a76df[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:41,922 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 00:54:41,922 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,924 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,925 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 00:54:41,925 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 00:54:41,925 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:41,925 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,925 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:41,926 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,926 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 00:54:41,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:41,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:41,926 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:41,926 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 00:54:41,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:41,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 00:54:41,928 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 00:54:41,929 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:41,929 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:41,929 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,929 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:41,930 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,930 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:41,930 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:41,931 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:41,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:41,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:41,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,932 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:41,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,934 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,934 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,934 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,934 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:41,934 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:41,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:41,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:41,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 00:54:41,934 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:41,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:41,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:41,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:41,934 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:41,935 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,935 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,935 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:41,935 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:41,935 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:42,035 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:42,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:42,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:42,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:42,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,041 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:42,041 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:42,042 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 00:54:42,042 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 00:54:42,042 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,042 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,044 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:42,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:42,044 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:42,044 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,045 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:42,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,045 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,045 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 00:54:42,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,045 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 00:54:42,045 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:42,045 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 00:54:42,046 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:42,046 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:42,046 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:42,046 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. started... 2023-03-11 00:54:42,046 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2821f2e121861947edb0825c770e8e9f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:42,458 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a8ce168e3361402ab0695dcd27033c19 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231a8ce168e3361402ab0695dcd27033c19 2023-03-11 00:54:42,864 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/43274a5183214b9293861da4b3129f60 2023-03-11 00:54:42,868 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/43274a5183214b9293861da4b3129f60 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/43274a5183214b9293861da4b3129f60 2023-03-11 00:54:42,872 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/43274a5183214b9293861da4b3129f60, entries=1, sequenceid=25, filesize=5.0 K 2023-03-11 00:54:42,873 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2821f2e121861947edb0825c770e8e9f in 827ms, sequenceid=25, compaction requested=true 2023-03-11 00:54:42,873 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:42,873 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 00:54:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 00:54:42,875 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,875 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:42,875 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,875 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:42,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 00:54:42,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a31e642[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:42,876 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 00:54:42,876 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,877 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,877 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 00:54:42,877 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 00:54:42,877 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:42,878 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,878 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:42,879 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,879 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 00:54:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:42,879 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:42,879 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 00:54:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:42,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 00:54:42,881 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 00:54:42,881 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:42,881 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:42,881 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,881 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:42,883 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,883 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:42,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:42,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,883 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:42,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:42,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:42,884 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,885 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,887 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:42,887 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:42,887 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:42,887 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:42,887 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:42,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:42,887 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:42,887 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,887 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,887 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:42,887 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:42,887 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:42,888 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:42,988 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:42,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:42,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:42,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:42,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,994 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:42,994 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:42,994 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 00:54:42,994 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 00:54:42,994 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,994 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,996 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,996 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:42,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:42,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:42,996 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:42,996 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:42,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,997 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,997 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 00:54:42,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:42,997 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 00:54:42,997 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:42,997 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 00:54:42,997 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:42,997 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:42,997 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:42,997 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. started... 2023-03-11 00:54:42,997 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2821f2e121861947edb0825c770e8e9f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:43,009 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101dab9a07e33e74b9180b5e73368f5c9cf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101dab9a07e33e74b9180b5e73368f5c9cf 2023-03-11 00:54:43,416 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/723c046c45834b9c857246b58fa5c0b1 2023-03-11 00:54:43,421 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/723c046c45834b9c857246b58fa5c0b1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/723c046c45834b9c857246b58fa5c0b1 2023-03-11 00:54:43,425 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/723c046c45834b9c857246b58fa5c0b1, entries=1, sequenceid=29, filesize=5.0 K 2023-03-11 00:54:43,426 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2821f2e121861947edb0825c770e8e9f in 429ms, sequenceid=29, compaction requested=true 2023-03-11 00:54:43,426 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:43,426 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:43,426 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:43,426 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:43,426 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,426 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 00:54:43,426 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 00:54:43,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,428 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:43,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:43,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:43,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:43,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:43,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:43,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 00:54:43,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66ed9a33[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:43,429 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 00:54:43,429 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,431 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,431 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 00:54:43,431 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,431 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:43,431 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 00:54:43,431 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:43,433 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 00:54:43,433 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,433 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:43,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:43,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:43,433 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 00:54:43,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:43,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:43,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:43,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:43,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 00:54:43,435 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 00:54:43,435 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:43,435 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:43,435 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,435 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:43,439 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,439 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:43,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,439 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:43,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:43,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:43,439 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:43,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,441 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:43,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:43,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:43,443 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:43,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:43,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:43,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:43,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:43,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,444 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,444 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,444 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,444 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,444 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:43,444 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:43,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:43,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:43,544 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:43,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:43,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:43,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:43,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,550 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:43,550 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:43,550 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 00:54:43,550 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 00:54:43,551 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,551 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,552 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:43,552 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:43,552 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:43,552 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,553 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,553 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 00:54:43,553 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:43,553 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 00:54:43,553 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:43,553 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 00:54:43,554 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:43,554 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:43,554 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:43,554 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. started... 2023-03-11 00:54:43,554 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2821f2e121861947edb0825c770e8e9f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:43,966 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033e6b5df123564f3996c8b17b30b12ec8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601033e6b5df123564f3996c8b17b30b12ec8 2023-03-11 00:54:44,372 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/16c0b8fcaeb140acb167739517174f61 2023-03-11 00:54:44,376 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/16c0b8fcaeb140acb167739517174f61 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/16c0b8fcaeb140acb167739517174f61 2023-03-11 00:54:44,380 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/16c0b8fcaeb140acb167739517174f61, entries=1, sequenceid=33, filesize=5.0 K 2023-03-11 00:54:44,381 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2821f2e121861947edb0825c770e8e9f in 827ms, sequenceid=33, compaction requested=true 2023-03-11 00:54:44,381 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:44,381 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:44,381 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:44,381 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:44,381 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,382 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 00:54:44,382 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 00:54:44,383 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,383 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:44,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:44,383 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,383 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:44,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 00:54:44,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a32182f[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:44,385 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 00:54:44,385 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,386 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,386 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 00:54:44,386 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 00:54:44,386 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:44,386 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,386 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:44,389 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,389 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 00:54:44,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:44,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:44,389 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:44,389 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 00:54:44,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:44,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:44,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:44,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:44,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 00:54:44,391 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 00:54:44,391 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:44,391 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:44,391 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,391 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:44,393 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,393 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:44,393 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:44,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:44,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,393 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:44,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:44,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,394 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:44,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,396 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:44,396 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,396 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:44,397 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:44,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:44,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:44,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:44,397 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,397 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:44,397 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:44,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:44,397 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:44,397 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,397 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:44,397 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,397 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,497 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:44,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:44,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:44,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:44,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,504 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:44,504 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:44,505 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 00:54:44,505 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 00:54:44,505 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,505 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,506 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,506 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:44,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:44,507 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,507 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,507 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,508 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 00:54:44,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,508 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 00:54:44,508 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:44,508 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 00:54:44,508 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:44,508 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:44,508 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:44,508 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. started... 2023-03-11 00:54:44,508 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2821f2e121861947edb0825c770e8e9f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:44,521 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076904859acf414ac58366fe8116a7897e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509076904859acf414ac58366fe8116a7897e 2023-03-11 00:54:44,931 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/365b6ebe71cc46789df26ee77d76520a 2023-03-11 00:54:44,935 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/365b6ebe71cc46789df26ee77d76520a as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/365b6ebe71cc46789df26ee77d76520a 2023-03-11 00:54:44,939 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/365b6ebe71cc46789df26ee77d76520a, entries=1, sequenceid=37, filesize=5.0 K 2023-03-11 00:54:44,940 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2821f2e121861947edb0825c770e8e9f in 432ms, sequenceid=37, compaction requested=true 2023-03-11 00:54:44,940 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:44,940 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:44,940 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:44,940 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:44,940 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,940 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 00:54:44,940 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 00:54:44,943 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,943 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:44,943 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,944 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:44,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 00:54:44,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31651538[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:44,945 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 00:54:44,945 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,946 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,946 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 00:54:44,946 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 00:54:44,946 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,946 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:44,946 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:44,948 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,948 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 00:54:44,948 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:44,948 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 00:54:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:44,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:44,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 00:54:44,950 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 00:54:44,950 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:44,950 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:44,950 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,950 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:44,952 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,952 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:44,952 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:44,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:44,952 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,953 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,959 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,959 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:44,959 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,960 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,960 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:44,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 00:54:44,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:44,959 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:44,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:44,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:44,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:44,960 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:44,960 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,960 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,960 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:44,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:44,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:44,960 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:44,960 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:45,060 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:45,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:45,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:45,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:45,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,067 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:45,067 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:45,067 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 00:54:45,067 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 00:54:45,068 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,068 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,069 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,069 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:45,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:45,069 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,069 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,070 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,070 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 00:54:45,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 00:54:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 00:54:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:45,071 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:45,071 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. started... 2023-03-11 00:54:45,071 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2821f2e121861947edb0825c770e8e9f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:45,484 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a05ccf2a81ff4d71b16a23837c2d8c4f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120a05ccf2a81ff4d71b16a23837c2d8c4f 2023-03-11 00:54:45,889 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/c3583873bd784445854c21620508f640 2023-03-11 00:54:45,894 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/c3583873bd784445854c21620508f640 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/c3583873bd784445854c21620508f640 2023-03-11 00:54:45,898 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/c3583873bd784445854c21620508f640, entries=1, sequenceid=41, filesize=5.0 K 2023-03-11 00:54:45,898 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2821f2e121861947edb0825c770e8e9f in 827ms, sequenceid=41, compaction requested=true 2023-03-11 00:54:45,898 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:45,898 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:45,899 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:45,899 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:45,899 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,899 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 00:54:45,899 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 00:54:45,900 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,900 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:45,900 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,900 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:45,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 00:54:45,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5483e6a0[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:45,902 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 00:54:45,902 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,903 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,903 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 00:54:45,903 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 00:54:45,903 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:45,903 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,903 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:45,910 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,910 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 00:54:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:45,910 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:45,910 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 00:54:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:45,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 00:54:45,912 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 00:54:45,912 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:45,912 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:45,912 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,912 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:45,913 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,913 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:45,913 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:45,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:45,914 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,915 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:45,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,917 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:45,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 00:54:45,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:45,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:45,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 00:54:45,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:45,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:45,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:45,918 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:45,918 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:45,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:46,018 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:46,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:46,021 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:46,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 00:54:46,024 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 00:54:46,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:46,024 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496686024 2023-03-11 00:54:46,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:54:46,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-11 00:54:46,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:46,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x5a439c42 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:54:46,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69644b17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:54:46,032 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:46,469 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103db3f1854fd1742678d081bd3e5bdf684 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103db3f1854fd1742678d081bd3e5bdf684 2023-03-11 00:54:46,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:46,484 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:54:46,485 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:54:46,493 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:54:46,495 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50596, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:54:46,504 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4052c05243e74a7f909a524de70b6e27 first=Optional[r3] last=Optional[r6] 2023-03-11 00:54:46,504 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4052c05243e74a7f909a524de70b6e27}] 2023-03-11 00:54:46,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4052c05243e74a7f909a524de70b6e27 for inclusion in 2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:46,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-11 00:54:46,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:54:46,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:46,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4052c05243e74a7f909a524de70b6e27 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qu6rn5po0gl6n6uk94bhoa5i08d44b840ukt4gofhu7og5l8mfqng5rqjgeq0dnr/family1/4052c05243e74a7f909a524de70b6e27 2023-03-11 00:54:46,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qu6rn5po0gl6n6uk94bhoa5i08d44b840ukt4gofhu7og5l8mfqng5rqjgeq0dnr/family1/4052c05243e74a7f909a524de70b6e27 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/7b061c91dd6b4f61ad63e03ae689091a_SeqId_44_ 2023-03-11 00:54:46,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qu6rn5po0gl6n6uk94bhoa5i08d44b840ukt4gofhu7og5l8mfqng5rqjgeq0dnr/family1/4052c05243e74a7f909a524de70b6e27 into 2821f2e121861947edb0825c770e8e9f/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/7b061c91dd6b4f61ad63e03ae689091a_SeqId_44_ - updating store file list. 2023-03-11 00:54:46,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/7b061c91dd6b4f61ad63e03ae689091a_SeqId_44_ into 2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:46,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qu6rn5po0gl6n6uk94bhoa5i08d44b840ukt4gofhu7og5l8mfqng5rqjgeq0dnr/family1/4052c05243e74a7f909a524de70b6e27 into 2821f2e121861947edb0825c770e8e9f/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/7b061c91dd6b4f61ad63e03ae689091a_SeqId_44_) 2023-03-11 00:54:46,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qu6rn5po0gl6n6uk94bhoa5i08d44b840ukt4gofhu7og5l8mfqng5rqjgeq0dnr/family1/4052c05243e74a7f909a524de70b6e27 2023-03-11 00:54:46,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 00:54:46,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 00:54:46,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 2821f2e121861947edb0825c770e8e9f/family1 is initiating minor compaction 2023-03-11 00:54:46,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@31a87a05; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:46,523 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2821f2e121861947edb0825c770e8e9f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:46,523 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/632048e748584a939cf097876fbb3cf0, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/191877288abb409dab0797dbeb01c1e9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/6ff51459ab744d0a93f0c7dfffc7e601, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/332bbd6751f9401490961b0305dd5f52, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/43274a5183214b9293861da4b3129f60, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/723c046c45834b9c857246b58fa5c0b1, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/16c0b8fcaeb140acb167739517174f61, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/365b6ebe71cc46789df26ee77d76520a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/c3583873bd784445854c21620508f640, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/7b061c91dd6b4f61ad63e03ae689091a_SeqId_44_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp, totalSize=50.4 K 2023-03-11 00:54:46,523 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 632048e748584a939cf097876fbb3cf0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 00:54:46,523 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 191877288abb409dab0797dbeb01c1e9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 00:54:46,523 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 6ff51459ab744d0a93f0c7dfffc7e601, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 00:54:46,523 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 332bbd6751f9401490961b0305dd5f52, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 00:54:46,523 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 43274a5183214b9293861da4b3129f60, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 00:54:46,523 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 723c046c45834b9c857246b58fa5c0b1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 00:54:46,524 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 16c0b8fcaeb140acb167739517174f61, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 00:54:46,524 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 365b6ebe71cc46789df26ee77d76520a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 00:54:46,524 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting c3583873bd784445854c21620508f640, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 00:54:46,524 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 7b061c91dd6b4f61ad63e03ae689091a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 00:54:46,525 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:46,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:46,529 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228de77e7134b044f51b8f750f2e449171a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228de77e7134b044f51b8f750f2e449171a 2023-03-11 00:54:46,530 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231a8ce168e3361402ab0695dcd27033c19 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231a8ce168e3361402ab0695dcd27033c19 2023-03-11 00:54:46,532 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101dab9a07e33e74b9180b5e73368f5c9cf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101dab9a07e33e74b9180b5e73368f5c9cf 2023-03-11 00:54:46,533 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601033e6b5df123564f3996c8b17b30b12ec8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601033e6b5df123564f3996c8b17b30b12ec8 2023-03-11 00:54:46,533 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-11 00:54:46,533 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-11 00:54:46,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:46,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:46,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:46,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:46,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:46,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:46,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:46,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:46,573 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2821f2e121861947edb0825c770e8e9f#family1#compaction#59 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:54:46,607 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/4104b11e475f4e3ebf90ac34e820b0aa as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/4104b11e475f4e3ebf90ac34e820b0aa 2023-03-11 00:54:46,612 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 2821f2e121861947edb0825c770e8e9f/family1 of 2821f2e121861947edb0825c770e8e9f into 4104b11e475f4e3ebf90ac34e820b0aa(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:54:46,612 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:46,612 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678496086523; duration=0sec 2023-03-11 00:54:46,613 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:46,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/632048e748584a939cf097876fbb3cf0, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/191877288abb409dab0797dbeb01c1e9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/6ff51459ab744d0a93f0c7dfffc7e601, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/332bbd6751f9401490961b0305dd5f52, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/43274a5183214b9293861da4b3129f60, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/723c046c45834b9c857246b58fa5c0b1, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/16c0b8fcaeb140acb167739517174f61, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/365b6ebe71cc46789df26ee77d76520a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/c3583873bd784445854c21620508f640, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/7b061c91dd6b4f61ad63e03ae689091a_SeqId_44_] to archive 2023-03-11 00:54:46,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:46,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/632048e748584a939cf097876fbb3cf0 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/632048e748584a939cf097876fbb3cf0 2023-03-11 00:54:46,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/191877288abb409dab0797dbeb01c1e9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/191877288abb409dab0797dbeb01c1e9 2023-03-11 00:54:46,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/6ff51459ab744d0a93f0c7dfffc7e601 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/6ff51459ab744d0a93f0c7dfffc7e601 2023-03-11 00:54:46,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/332bbd6751f9401490961b0305dd5f52 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/332bbd6751f9401490961b0305dd5f52 2023-03-11 00:54:46,674 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/43274a5183214b9293861da4b3129f60 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/43274a5183214b9293861da4b3129f60 2023-03-11 00:54:46,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/723c046c45834b9c857246b58fa5c0b1 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/723c046c45834b9c857246b58fa5c0b1 2023-03-11 00:54:46,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/16c0b8fcaeb140acb167739517174f61 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/16c0b8fcaeb140acb167739517174f61 2023-03-11 00:54:46,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/365b6ebe71cc46789df26ee77d76520a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/365b6ebe71cc46789df26ee77d76520a 2023-03-11 00:54:46,678 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/c3583873bd784445854c21620508f640 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/c3583873bd784445854c21620508f640 2023-03-11 00:54:46,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/7b061c91dd6b4f61ad63e03ae689091a_SeqId_44_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/7b061c91dd6b4f61ad63e03ae689091a_SeqId_44_ 2023-03-11 00:54:47,407 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120558abf07baac54b8b9536d2042fc095bf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120558abf07baac54b8b9536d2042fc095bf 2023-03-11 00:54:47,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:47,435 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3542f1cfcb874bc8824290a1348c3b1b first=Optional[r00] last=Optional[r2] 2023-03-11 00:54:47,436 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3542f1cfcb874bc8824290a1348c3b1b}] 2023-03-11 00:54:47,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3542f1cfcb874bc8824290a1348c3b1b for inclusion in 2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:47,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-11 00:54:47,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:54:47,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:47,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3542f1cfcb874bc8824290a1348c3b1b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ps5mvrc91mlj4retung3a0c6bl9psvtovg6mj9tce35dkn6dg65sklhvp3s8ro0t/family1/3542f1cfcb874bc8824290a1348c3b1b 2023-03-11 00:54:47,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ps5mvrc91mlj4retung3a0c6bl9psvtovg6mj9tce35dkn6dg65sklhvp3s8ro0t/family1/3542f1cfcb874bc8824290a1348c3b1b as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/f8d8eb51edfd43d9b90e769f8e3cb2e6_SeqId_47_ 2023-03-11 00:54:47,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ps5mvrc91mlj4retung3a0c6bl9psvtovg6mj9tce35dkn6dg65sklhvp3s8ro0t/family1/3542f1cfcb874bc8824290a1348c3b1b into 2821f2e121861947edb0825c770e8e9f/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/f8d8eb51edfd43d9b90e769f8e3cb2e6_SeqId_47_ - updating store file list. 2023-03-11 00:54:47,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/f8d8eb51edfd43d9b90e769f8e3cb2e6_SeqId_47_ into 2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:47,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ps5mvrc91mlj4retung3a0c6bl9psvtovg6mj9tce35dkn6dg65sklhvp3s8ro0t/family1/3542f1cfcb874bc8824290a1348c3b1b into 2821f2e121861947edb0825c770e8e9f/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/f8d8eb51edfd43d9b90e769f8e3cb2e6_SeqId_47_) 2023-03-11 00:54:47,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ps5mvrc91mlj4retung3a0c6bl9psvtovg6mj9tce35dkn6dg65sklhvp3s8ro0t/family1/3542f1cfcb874bc8824290a1348c3b1b 2023-03-11 00:54:47,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 00:54:47,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 00:54:47,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 2821f2e121861947edb0825c770e8e9f/family1 is initiating minor compaction (all files) 2023-03-11 00:54:47,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7b188eac; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:47,451 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2821f2e121861947edb0825c770e8e9f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:47,451 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/22ca9f80dbd844c7b925fededf736e08, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/4104b11e475f4e3ebf90ac34e820b0aa, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/f8d8eb51edfd43d9b90e769f8e3cb2e6_SeqId_47_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp, totalSize=390.1 K 2023-03-11 00:54:47,452 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 22ca9f80dbd844c7b925fededf736e08, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839224 2023-03-11 00:54:47,452 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 4104b11e475f4e3ebf90ac34e820b0aa, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239224 2023-03-11 00:54:47,453 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting f8d8eb51edfd43d9b90e769f8e3cb2e6_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878839224 2023-03-11 00:54:47,453 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:47,454 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:47,455 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511301b1964cef098414fb89ba86dbaf1ff66 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511301b1964cef098414fb89ba86dbaf1ff66 2023-03-11 00:54:47,456 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120153c04cc99f8145e9bbe0e344c402643b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120153c04cc99f8145e9bbe0e344c402643b 2023-03-11 00:54:47,458 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205f2d04cf6973e4823a352dbd85e05684c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205f2d04cf6973e4823a352dbd85e05684c 2023-03-11 00:54:47,458 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-11 00:54:47,458 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-11 00:54:47,458 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:47,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:47,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:47,459 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 00:54:47,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4370 sec 2023-03-11 00:54:47,467 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2821f2e121861947edb0825c770e8e9f#family1#compaction#60 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:54:47,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-11 00:54:47,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:47,952 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-11 00:54:47,953 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-11 00:54:47,954 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-11 00:54:47,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-11 00:54:47,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, REOPEN/MOVE}] 2023-03-11 00:54:47,958 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, REOPEN/MOVE 2023-03-11 00:54:47,959 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=2821f2e121861947edb0825c770e8e9f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:47,959 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496087959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496087959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496087959"}]},"ts":"1678496087959"} 2023-03-11 00:54:47,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 2821f2e121861947edb0825c770e8e9f, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:48,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:48,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2821f2e121861947edb0825c770e8e9f, disabling compactions & flushes 2023-03-11 00:54:48,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:48,689 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/.tmp/family1/b48aac65155546779caf215198b32c89 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/b48aac65155546779caf215198b32c89 2023-03-11 00:54:48,694 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2821f2e121861947edb0825c770e8e9f/family1 of 2821f2e121861947edb0825c770e8e9f into b48aac65155546779caf215198b32c89(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:54:48,694 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:48,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:48,694 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1678496087451; duration=1sec 2023-03-11 00:54:48,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:48,694 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:54:48,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. after waiting 0 ms 2023-03-11 00:54:48,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:48,695 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/22ca9f80dbd844c7b925fededf736e08, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/4104b11e475f4e3ebf90ac34e820b0aa, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/f8d8eb51edfd43d9b90e769f8e3cb2e6_SeqId_47_] to archive 2023-03-11 00:54:48,696 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:48,698 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/22ca9f80dbd844c7b925fededf736e08 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/22ca9f80dbd844c7b925fededf736e08 2023-03-11 00:54:48,700 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/4104b11e475f4e3ebf90ac34e820b0aa to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/4104b11e475f4e3ebf90ac34e820b0aa 2023-03-11 00:54:48,701 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/f8d8eb51edfd43d9b90e769f8e3cb2e6_SeqId_47_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/f8d8eb51edfd43d9b90e769f8e3cb2e6_SeqId_47_ 2023-03-11 00:54:48,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-11 00:54:48,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:48,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:48,707 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 2821f2e121861947edb0825c770e8e9f to self. 2023-03-11 00:54:48,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:48,709 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=2821f2e121861947edb0825c770e8e9f, regionState=CLOSED 2023-03-11 00:54:48,709 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496088709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496088709"}]},"ts":"1678496088709"} 2023-03-11 00:54:48,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-11 00:54:48,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 2821f2e121861947edb0825c770e8e9f, server=jenkins-hbase4.apache.org,38819,1678496016129 in 750 msec 2023-03-11 00:54:48,712 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=true 2023-03-11 00:54:48,863 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=2821f2e121861947edb0825c770e8e9f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:48,863 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496088862"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496088862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496088862"}]},"ts":"1678496088862"} 2023-03-11 00:54:48,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 2821f2e121861947edb0825c770e8e9f, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:49,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:49,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2821f2e121861947edb0825c770e8e9f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:54:49,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:49,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:49,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:49,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:49,021 INFO [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:49,021 DEBUG [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:49,022 DEBUG [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:49,022 INFO [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2821f2e121861947edb0825c770e8e9f columnFamilyName family1 2023-03-11 00:54:49,026 DEBUG [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/b48aac65155546779caf215198b32c89 2023-03-11 00:54:49,027 INFO [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] regionserver.HStore(310): Store=2821f2e121861947edb0825c770e8e9f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:49,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:49,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:49,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:49,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2821f2e121861947edb0825c770e8e9f; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69580669, jitterRate=0.036832764744758606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:54:49,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:49,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f., pid=47, masterSystemTime=1678496089016 2023-03-11 00:54:49,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:49,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:49,034 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=2821f2e121861947edb0825c770e8e9f, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:49,034 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496089034"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496089034"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496089034"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496089034"}]},"ts":"1678496089034"} 2023-03-11 00:54:49,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-11 00:54:49,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 2821f2e121861947edb0825c770e8e9f, server=jenkins-hbase4.apache.org,38819,1678496016129 in 172 msec 2023-03-11 00:54:49,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-11 00:54:49,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, REOPEN/MOVE in 1.0790 sec 2023-03-11 00:54:49,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-11 00:54:49,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0840 sec 2023-03-11 00:54:49,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5000 sec 2023-03-11 00:54:49,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-11 00:54:49,045 INFO [Listener at localhost/45619] compactions.TestMobCompactor(278): alter status finished 2023-03-11 00:54:49,046 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:49,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 00:54:49,048 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 00:54:49,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:49,048 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496689048 2023-03-11 00:54:49,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:54:49,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-11 00:54:49,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:49,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x4e5c7a44 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:54:49,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52bac6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:54:49,056 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:49,056 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:49,056 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:49,056 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:49,056 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:49,882 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282c7a98e984944f3ebc5af4bfaaef4b05 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282c7a98e984944f3ebc5af4bfaaef4b05 2023-03-11 00:54:49,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:49,896 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:54:49,897 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35686, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:54:49,903 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:54:49,905 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50604, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:54:49,922 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ce6c94148eba4673b60b30f910122587 first=Optional[r05] last=Optional[r8] 2023-03-11 00:54:49,923 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=51 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ce6c94148eba4673b60b30f910122587}] 2023-03-11 00:54:49,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ce6c94148eba4673b60b30f910122587 for inclusion in 2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:49,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-11 00:54:49,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:54:49,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:49,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ce6c94148eba4673b60b30f910122587 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ncpg7lmhsnk9hcvord8lkp1hqb37u8t5l5760rsvve3vdb67584mtn0djj5euov/family1/ce6c94148eba4673b60b30f910122587 2023-03-11 00:54:49,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ncpg7lmhsnk9hcvord8lkp1hqb37u8t5l5760rsvve3vdb67584mtn0djj5euov/family1/ce6c94148eba4673b60b30f910122587 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/399ff7be97b74dc6a35d75b7e9cca25c_SeqId_53_ 2023-03-11 00:54:49,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ncpg7lmhsnk9hcvord8lkp1hqb37u8t5l5760rsvve3vdb67584mtn0djj5euov/family1/ce6c94148eba4673b60b30f910122587 into 2821f2e121861947edb0825c770e8e9f/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/399ff7be97b74dc6a35d75b7e9cca25c_SeqId_53_ - updating store file list. 2023-03-11 00:54:49,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/399ff7be97b74dc6a35d75b7e9cca25c_SeqId_53_ into 2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:49,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ncpg7lmhsnk9hcvord8lkp1hqb37u8t5l5760rsvve3vdb67584mtn0djj5euov/family1/ce6c94148eba4673b60b30f910122587 into 2821f2e121861947edb0825c770e8e9f/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/399ff7be97b74dc6a35d75b7e9cca25c_SeqId_53_) 2023-03-11 00:54:49,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ncpg7lmhsnk9hcvord8lkp1hqb37u8t5l5760rsvve3vdb67584mtn0djj5euov/family1/ce6c94148eba4673b60b30f910122587 2023-03-11 00:54:49,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:49,941 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:54:49,943 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120a05ccf2a81ff4d71b16a23837c2d8c4f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120a05ccf2a81ff4d71b16a23837c2d8c4f 2023-03-11 00:54:49,944 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128fc5064219ba340f7848976f6d6b1bf72 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128fc5064219ba340f7848976f6d6b1bf72 2023-03-11 00:54:49,944 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-11 00:54:49,944 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-11 00:54:49,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:49,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:49,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:49,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:49,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:49,946 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 00:54:49,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 899 msec 2023-03-11 00:54:49,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 00:54:49,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:50,405 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-11 00:54:50,407 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-11 00:54:50,407 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-11 00:54:50,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-11 00:54:50,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, REOPEN/MOVE}] 2023-03-11 00:54:50,412 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, REOPEN/MOVE 2023-03-11 00:54:50,413 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=2821f2e121861947edb0825c770e8e9f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:50,413 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496090413"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496090413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496090413"}]},"ts":"1678496090413"} 2023-03-11 00:54:50,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 2821f2e121861947edb0825c770e8e9f, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:50,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:50,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2821f2e121861947edb0825c770e8e9f, disabling compactions & flushes 2023-03-11 00:54:50,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:50,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:50,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. after waiting 0 ms 2023-03-11 00:54:50,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:50,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-11 00:54:50,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:50,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:50,573 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 2821f2e121861947edb0825c770e8e9f to self. 2023-03-11 00:54:50,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:50,574 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=2821f2e121861947edb0825c770e8e9f, regionState=CLOSED 2023-03-11 00:54:50,574 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496090574"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496090574"}]},"ts":"1678496090574"} 2023-03-11 00:54:50,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-11 00:54:50,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 2821f2e121861947edb0825c770e8e9f, server=jenkins-hbase4.apache.org,38819,1678496016129 in 161 msec 2023-03-11 00:54:50,577 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=true 2023-03-11 00:54:50,728 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=2821f2e121861947edb0825c770e8e9f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:50,728 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496090727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496090727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496090727"}]},"ts":"1678496090727"} 2023-03-11 00:54:50,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 2821f2e121861947edb0825c770e8e9f, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:50,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:50,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2821f2e121861947edb0825c770e8e9f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:54:50,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:50,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:50,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:50,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:50,885 INFO [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:50,886 DEBUG [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:50,886 DEBUG [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1 2023-03-11 00:54:50,887 INFO [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2821f2e121861947edb0825c770e8e9f columnFamilyName family1 2023-03-11 00:54:50,892 DEBUG [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/399ff7be97b74dc6a35d75b7e9cca25c_SeqId_53_ 2023-03-11 00:54:50,895 DEBUG [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/family1/b48aac65155546779caf215198b32c89 2023-03-11 00:54:50,895 INFO [StoreOpener-2821f2e121861947edb0825c770e8e9f-1] regionserver.HStore(310): Store=2821f2e121861947edb0825c770e8e9f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:50,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:50,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:50,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:54:50,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2821f2e121861947edb0825c770e8e9f; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59295738, jitterRate=-0.11642464995384216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:54:50,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:54:50,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f., pid=53, masterSystemTime=1678496090881 2023-03-11 00:54:50,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:50,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:54:50,903 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=2821f2e121861947edb0825c770e8e9f, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:50,903 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678496090903"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496090903"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496090903"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496090903"}]},"ts":"1678496090903"} 2023-03-11 00:54:50,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-11 00:54:50,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 2821f2e121861947edb0825c770e8e9f, server=jenkins-hbase4.apache.org,38819,1678496016129 in 175 msec 2023-03-11 00:54:50,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-11 00:54:50,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=2821f2e121861947edb0825c770e8e9f, REOPEN/MOVE in 494 msec 2023-03-11 00:54:50,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-11 00:54:50,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 498 msec 2023-03-11 00:54:50,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 915 msec 2023-03-11 00:54:50,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-11 00:54:50,912 INFO [Listener at localhost/45619] compactions.TestMobCompactor(278): alter status finished 2023-03-11 00:54:50,913 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 00:54:50,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 00:54:50,914 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 00:54:50,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:50,915 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496690915 2023-03-11 00:54:50,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:54:50,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-11 00:54:50,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:50,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x192daab9 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:54:50,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41bd0503, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:54:50,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:50,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:50,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:50,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:50,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:50,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:50,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:50,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 00:54:50,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 00:54:50,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:54:50,922 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 00:54:50,923 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-03-11 00:54:50,969 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=247 (was 257), OpenFileDescriptor=636 (was 629) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 236), ProcessCount=170 (was 170), AvailableMemoryMB=5548 (was 5559) 2023-03-11 00:54:50,979 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=247, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=170, AvailableMemoryMB=5547 2023-03-11 00:54:50,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 00:54:50,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:50,983 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:54:50,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-11 00:54:50,984 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:54:50,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-11 00:54:50,985 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9 2023-03-11 00:54:50,986 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9 empty. 2023-03-11 00:54:50,986 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9 2023-03-11 00:54:50,986 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-11 00:54:51,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-11 00:54:51,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-11 00:54:51,395 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-11 00:54:51,396 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 080973ca19275505e5727ec713c114b9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:54:51,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-11 00:54:51,802 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:51,802 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 080973ca19275505e5727ec713c114b9, disabling compactions & flushes 2023-03-11 00:54:51,802 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:51,802 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:51,802 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. after waiting 0 ms 2023-03-11 00:54:51,802 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:51,802 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:51,802 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:54:51,804 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:54:51,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496091805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496091805"}]},"ts":"1678496091805"} 2023-03-11 00:54:51,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 00:54:51,807 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:54:51,808 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496091807"}]},"ts":"1678496091807"} 2023-03-11 00:54:51,809 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-11 00:54:51,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, ASSIGN}] 2023-03-11 00:54:51,813 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, ASSIGN 2023-03-11 00:54:51,814 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:54:51,965 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=080973ca19275505e5727ec713c114b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:51,965 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496091965"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496091965"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496091965"}]},"ts":"1678496091965"} 2023-03-11 00:54:51,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 080973ca19275505e5727ec713c114b9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:54:52,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-11 00:54:52,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:52,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 080973ca19275505e5727ec713c114b9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:54:52,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 080973ca19275505e5727ec713c114b9 2023-03-11 00:54:52,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:54:52,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 080973ca19275505e5727ec713c114b9 2023-03-11 00:54:52,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 080973ca19275505e5727ec713c114b9 2023-03-11 00:54:52,123 INFO [StoreOpener-080973ca19275505e5727ec713c114b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 080973ca19275505e5727ec713c114b9 2023-03-11 00:54:52,125 DEBUG [StoreOpener-080973ca19275505e5727ec713c114b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:54:52,125 DEBUG [StoreOpener-080973ca19275505e5727ec713c114b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:54:52,126 INFO [StoreOpener-080973ca19275505e5727ec713c114b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 080973ca19275505e5727ec713c114b9 columnFamilyName family1 2023-03-11 00:54:52,127 INFO [StoreOpener-080973ca19275505e5727ec713c114b9-1] regionserver.HStore(310): Store=080973ca19275505e5727ec713c114b9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:54:52,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9 2023-03-11 00:54:52,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9 2023-03-11 00:54:52,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 080973ca19275505e5727ec713c114b9 2023-03-11 00:54:52,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:54:52,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 080973ca19275505e5727ec713c114b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63675641, jitterRate=-0.05115900933742523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:54:52,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:54:52,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9., pid=57, masterSystemTime=1678496092118 2023-03-11 00:54:52,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:52,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:52,137 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=080973ca19275505e5727ec713c114b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:52,138 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496092137"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496092137"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496092137"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496092137"}]},"ts":"1678496092137"} 2023-03-11 00:54:52,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-11 00:54:52,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 080973ca19275505e5727ec713c114b9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 172 msec 2023-03-11 00:54:52,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-11 00:54:52,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, ASSIGN in 328 msec 2023-03-11 00:54:52,142 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:54:52,142 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496092142"}]},"ts":"1678496092142"} 2023-03-11 00:54:52,143 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-11 00:54:52,146 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:54:52,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1650 sec 2023-03-11 00:54:53,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-11 00:54:53,090 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-11 00:54:53,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:53,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,118 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:53,118 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:53,118 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 00:54:53,118 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 00:54:53,118 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,118 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,119 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:53,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:53,119 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:53,120 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,120 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:53,120 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,121 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,121 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,121 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 00:54:53,121 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:53,121 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 00:54:53,122 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:53,122 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:53,122 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:53,122 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. started... 2023-03-11 00:54:53,123 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 080973ca19275505e5727ec713c114b9 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 00:54:53,544 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c65a0e3774ef498780dfa3ba33c41e87 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c65a0e3774ef498780dfa3ba33c41e87 2023-03-11 00:54:53,548 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/61dcc31fdea24acd8a74ff7980f7d0a7 2023-03-11 00:54:53,553 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/61dcc31fdea24acd8a74ff7980f7d0a7 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/61dcc31fdea24acd8a74ff7980f7d0a7 2023-03-11 00:54:53,557 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/61dcc31fdea24acd8a74ff7980f7d0a7, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-11 00:54:53,558 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 080973ca19275505e5727ec713c114b9 in 435ms, sequenceid=5, compaction requested=false 2023-03-11 00:54:53,558 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:53,559 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:54:53,559 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:53,559 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:53,559 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:53,559 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,560 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 00:54:53,560 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 00:54:53,561 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,561 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:53,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:53,561 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,561 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:53,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 00:54:53,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5eb5c201[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:53,563 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 00:54:53,563 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,564 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,564 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 00:54:53,564 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,565 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:53,564 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 00:54:53,565 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:53,567 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,567 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 00:54:53,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:53,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:53,567 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:53,567 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 00:54:53,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:53,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:53,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:53,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:53,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 00:54:53,569 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 00:54:53,569 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:53,569 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:53,570 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,570 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:53,571 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,571 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:53,571 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:53,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:53,571 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:53,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:53,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,572 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:53,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,581 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,581 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:53,581 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,581 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:53,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:53,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:53,581 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:53,581 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:53,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:53,581 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,581 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,581 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,581 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:53,582 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:53,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:53,582 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:53,682 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:53,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:53,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:53,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:53,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,688 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:53,689 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:53,689 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 00:54:53,689 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 00:54:53,689 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,689 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,691 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,691 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:53,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:53,692 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:53,692 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,692 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,693 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 00:54:53,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 00:54:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 00:54:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:53,693 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:53,693 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. started... 2023-03-11 00:54:53,693 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 080973ca19275505e5727ec713c114b9 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 00:54:54,106 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112846e13673a2b54effbdd0a01f8e2a47fa to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112846e13673a2b54effbdd0a01f8e2a47fa 2023-03-11 00:54:54,243 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:54:54,512 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/8feea2368db64c249843e149ed19ba71 2023-03-11 00:54:54,516 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/8feea2368db64c249843e149ed19ba71 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8feea2368db64c249843e149ed19ba71 2023-03-11 00:54:54,521 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8feea2368db64c249843e149ed19ba71, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 00:54:54,522 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 080973ca19275505e5727ec713c114b9 in 829ms, sequenceid=9, compaction requested=false 2023-03-11 00:54:54,522 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:54:54,522 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:54,522 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:54,522 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:54,522 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,522 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 00:54:54,522 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 00:54:54,546 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,547 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:54,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:54,547 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x192daab9 to 127.0.0.1:62412 2023-03-11 00:54:54,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:54,547 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,547 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:54,547 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:54:54,548 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:54:54,548 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e5c7a44 to 127.0.0.1:62412 2023-03-11 00:54:54,548 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:54:54,548 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:54:54,548 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a439c42 to 127.0.0.1:62412 2023-03-11 00:54:54,548 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:54:54,548 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:54:54,548 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d31b165 to 127.0.0.1:62412 2023-03-11 00:54:54,548 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:54:54,548 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:54:54,548 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6dfa94f1 to 127.0.0.1:62412 2023-03-11 00:54:54,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:54,549 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:54:54,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:54,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 00:54:54,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@342c4a98[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:54,656 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 00:54:54,656 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,657 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,657 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 00:54:54,657 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 00:54:54,657 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:54,657 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,657 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:54,658 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,658 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 00:54:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,658 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:54,659 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 00:54:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:54,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 00:54:54,661 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 00:54:54,661 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:54,661 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:54,661 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,661 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:54,662 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,662 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:54,662 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:54,663 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,664 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:54,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:54,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 00:54:54,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:54,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:54,668 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:54,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:54,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:54,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,668 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:54,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,668 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:54,669 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:54,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:54,769 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:54,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:54,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:54,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:54,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,775 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:54,775 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:54,775 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 00:54:54,775 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 00:54:54,775 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,776 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,777 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,777 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:54,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:54,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:54,777 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:54,777 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:54,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:54,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,778 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,778 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 00:54:54,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:54,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 00:54:54,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:54,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 00:54:54,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:54,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:54,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:54,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. started... 2023-03-11 00:54:54,779 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 080973ca19275505e5727ec713c114b9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:55,190 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b08f5b0a386a4795b6fcd173e9b3c726 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b08f5b0a386a4795b6fcd173e9b3c726 2023-03-11 00:54:55,596 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/7e8175812d4343d882c2b06393ae3f62 2023-03-11 00:54:55,600 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/7e8175812d4343d882c2b06393ae3f62 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/7e8175812d4343d882c2b06393ae3f62 2023-03-11 00:54:55,603 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/7e8175812d4343d882c2b06393ae3f62, entries=1, sequenceid=13, filesize=5.0 K 2023-03-11 00:54:55,604 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 080973ca19275505e5727ec713c114b9 in 825ms, sequenceid=13, compaction requested=true 2023-03-11 00:54:55,604 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:54:55,604 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:55,604 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:55,604 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:55,604 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,604 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 00:54:55,604 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 00:54:55,606 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,606 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:55,606 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,606 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 00:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2df945f0[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:55,607 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 00:54:55,608 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,608 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,609 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 00:54:55,609 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 00:54:55,609 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:55,609 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,609 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:55,611 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 00:54:55,611 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,611 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:55,611 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 00:54:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:55,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 00:54:55,613 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 00:54:55,613 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:55,613 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:55,613 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,613 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:55,614 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,614 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:55,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,614 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:55,615 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,616 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,617 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:55,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:55,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,618 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:55,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:55,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 00:54:55,618 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:55,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:55,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:55,618 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:55,618 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:55,719 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:55,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:55,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:55,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:55,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,725 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:55,725 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:55,725 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 00:54:55,725 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 00:54:55,726 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,726 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,727 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,727 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:55,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:55,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:55,728 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:55,728 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:55,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,729 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,730 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 00:54:55,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 00:54:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:55,731 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 00:54:55,731 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:55,731 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:55,731 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:55,731 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. started... 2023-03-11 00:54:55,731 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 080973ca19275505e5727ec713c114b9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:56,146 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205707d6ac3df4f4db9bf5ed4ea84e2eca4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205707d6ac3df4f4db9bf5ed4ea84e2eca4 2023-03-11 00:54:56,551 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/957cd67e423445c2bd77682eff3ef7ad 2023-03-11 00:54:56,556 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/957cd67e423445c2bd77682eff3ef7ad as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/957cd67e423445c2bd77682eff3ef7ad 2023-03-11 00:54:56,560 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/957cd67e423445c2bd77682eff3ef7ad, entries=1, sequenceid=17, filesize=5.0 K 2023-03-11 00:54:56,561 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 080973ca19275505e5727ec713c114b9 in 830ms, sequenceid=17, compaction requested=true 2023-03-11 00:54:56,561 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:54:56,561 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:56,561 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:56,561 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:56,562 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,562 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 00:54:56,562 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 00:54:56,568 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,568 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:56,568 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,568 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:56,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 00:54:56,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66840009[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:56,570 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 00:54:56,570 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,571 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,571 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 00:54:56,571 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 00:54:56,571 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,571 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:56,572 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:56,573 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,573 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 00:54:56,573 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,573 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 00:54:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:56,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:56,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 00:54:56,575 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 00:54:56,576 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:56,576 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:56,576 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,576 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:56,577 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,577 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:56,577 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:56,578 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,579 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,582 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,582 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:56,582 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:56,582 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:56,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 00:54:56,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:56,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:56,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:56,582 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:56,582 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,583 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,583 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:56,583 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:56,583 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,583 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:56,583 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,683 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:56,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:56,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:56,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:56,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,689 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:56,689 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:56,690 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 00:54:56,690 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 00:54:56,690 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,690 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,691 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,691 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:56,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:56,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:56,691 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:56,691 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:56,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:56,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,692 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,692 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 00:54:56,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:56,692 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 00:54:56,692 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:56,692 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 00:54:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:56,693 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:56,693 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. started... 2023-03-11 00:54:56,693 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 080973ca19275505e5727ec713c114b9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:57,105 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ba551a12cdc14698a4aba6f39cec8fad to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ba551a12cdc14698a4aba6f39cec8fad 2023-03-11 00:54:57,511 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/556b291c8a4946af82f617713e372eb1 2023-03-11 00:54:57,515 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/556b291c8a4946af82f617713e372eb1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/556b291c8a4946af82f617713e372eb1 2023-03-11 00:54:57,520 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/556b291c8a4946af82f617713e372eb1, entries=1, sequenceid=21, filesize=5.0 K 2023-03-11 00:54:57,520 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 080973ca19275505e5727ec713c114b9 in 827ms, sequenceid=21, compaction requested=true 2023-03-11 00:54:57,521 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:54:57,521 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:57,521 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:57,521 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:57,521 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,521 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 00:54:57,521 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 00:54:57,523 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,523 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:57,523 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,523 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:57,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 00:54:57,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16516312[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:57,525 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 00:54:57,525 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,526 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,527 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 00:54:57,527 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 00:54:57,527 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:57,527 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,527 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:57,529 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 00:54:57,529 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,529 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:57,529 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 00:54:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:57,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 00:54:57,532 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 00:54:57,532 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:57,532 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:57,532 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,532 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:57,533 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,533 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,533 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:57,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:57,534 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,535 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:57,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,537 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,537 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:57,537 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,537 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:57,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:57,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:57,537 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:57,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:57,537 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:57,537 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,538 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,538 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:57,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:57,538 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:57,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:57,538 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,538 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,638 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:57,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:57,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:57,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:57,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,644 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:57,644 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:57,644 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 00:54:57,644 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 00:54:57,644 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,645 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,646 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,646 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:57,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:57,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:57,646 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:57,646 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:57,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 00:54:57,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:57,647 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 00:54:57,647 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:57,647 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 00:54:57,647 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:57,647 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:57,647 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:57,647 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. started... 2023-03-11 00:54:57,647 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 080973ca19275505e5727ec713c114b9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:58,060 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316df0585fc787404ea8de5be13e4c96d8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316df0585fc787404ea8de5be13e4c96d8 2023-03-11 00:54:58,465 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/e6755d1827734c40a942582acac3e5bc 2023-03-11 00:54:58,470 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/e6755d1827734c40a942582acac3e5bc as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/e6755d1827734c40a942582acac3e5bc 2023-03-11 00:54:58,475 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/e6755d1827734c40a942582acac3e5bc, entries=1, sequenceid=25, filesize=5.0 K 2023-03-11 00:54:58,476 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 080973ca19275505e5727ec713c114b9 in 829ms, sequenceid=25, compaction requested=true 2023-03-11 00:54:58,476 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:54:58,476 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 00:54:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 00:54:58,479 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,479 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:58,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:58,479 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,479 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:58,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:58,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:58,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:58,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 00:54:58,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40ff93ca[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:58,481 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 00:54:58,481 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,482 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,482 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 00:54:58,482 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 00:54:58,482 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:58,482 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,482 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:58,483 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,483 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 00:54:58,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:58,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:58,483 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:58,483 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 00:54:58,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:58,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:58,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:58,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:58,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 00:54:58,485 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 00:54:58,485 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:58,485 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:58,485 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,485 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:58,487 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,487 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:58,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:58,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,487 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:58,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,488 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:58,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:58,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:58,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:58,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,489 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:58,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,494 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,494 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:58,494 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,494 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:58,494 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:58,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:58,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 00:54:58,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:58,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:58,494 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:58,495 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,495 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,495 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:58,495 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:58,495 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:58,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:58,495 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,595 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:58,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:58,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:58,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:58,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,601 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:58,601 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:58,601 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 00:54:58,601 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 00:54:58,601 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,601 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,605 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,605 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:58,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:58,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:58,605 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:58,605 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,606 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,606 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 00:54:58,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:58,607 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 00:54:58,607 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:58,607 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 00:54:58,607 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:58,607 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:58,607 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:58,607 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. started... 2023-03-11 00:54:58,607 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 080973ca19275505e5727ec713c114b9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:59,019 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101eec6fd4ee62c47358ec03e3b3d2db86a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101eec6fd4ee62c47358ec03e3b3d2db86a 2023-03-11 00:54:59,425 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/8f7fb8ed4c3f4325abe533951db3b9aa 2023-03-11 00:54:59,429 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/8f7fb8ed4c3f4325abe533951db3b9aa as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8f7fb8ed4c3f4325abe533951db3b9aa 2023-03-11 00:54:59,432 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8f7fb8ed4c3f4325abe533951db3b9aa, entries=1, sequenceid=29, filesize=5.0 K 2023-03-11 00:54:59,433 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 080973ca19275505e5727ec713c114b9 in 826ms, sequenceid=29, compaction requested=true 2023-03-11 00:54:59,433 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:54:59,433 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:54:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:54:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 00:54:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 00:54:59,435 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,435 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:59,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:59,435 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,435 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:54:59,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:59,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:59,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:59,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 00:54:59,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@274e98e0[Count = 0] remaining members to acquire global barrier 2023-03-11 00:54:59,436 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 00:54:59,436 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,437 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,438 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 00:54:59,438 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 00:54:59,438 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,438 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:54:59,438 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:54:59,440 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,440 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 00:54:59,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:59,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:59,440 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:59,441 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 00:54:59,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:59,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:59,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:59,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:54:59,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 00:54:59,442 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 00:54:59,443 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:54:59,443 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:54:59,443 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,443 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:54:59,444 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,444 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,444 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:54:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:54:59,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:54:59,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:59,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:59,445 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:54:59,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,446 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:54:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,448 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,448 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,448 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:59,448 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:54:59,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:59,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:59,448 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:54:59,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:59,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:54:59,448 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,448 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,448 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,448 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:54:59,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:54:59,449 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 00:54:59,448 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,449 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:54:59,549 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:54:59,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:54:59,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:54:59,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 00:54:59,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,556 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:54:59,556 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:59,556 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 00:54:59,556 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 00:54:59,558 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,558 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,559 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:54:59,559 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:54:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:54:59,559 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:54:59,560 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:54:59,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:54:59,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,560 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,564 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 00:54:59,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:54:59,564 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 00:54:59,564 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:54:59,564 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 00:54:59,565 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:54:59,565 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:54:59,565 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:54:59,565 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. started... 2023-03-11 00:54:59,565 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 080973ca19275505e5727ec713c114b9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:54:59,582 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103edba6e2fa4484b5bad527a7cd5268b93 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103edba6e2fa4484b5bad527a7cd5268b93 2023-03-11 00:54:59,991 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/9ca60b2d5b984a9988ff9563e0240b51 2023-03-11 00:54:59,995 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/9ca60b2d5b984a9988ff9563e0240b51 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/9ca60b2d5b984a9988ff9563e0240b51 2023-03-11 00:54:59,999 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/9ca60b2d5b984a9988ff9563e0240b51, entries=1, sequenceid=33, filesize=5.0 K 2023-03-11 00:55:00,000 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 080973ca19275505e5727ec713c114b9 in 435ms, sequenceid=33, compaction requested=true 2023-03-11 00:55:00,000 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:00,000 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:00,000 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:55:00,000 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:55:00,000 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,000 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 00:55:00,000 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 00:55:00,002 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,002 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:00,003 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:00,003 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:00,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 00:55:00,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@618c4048[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:00,004 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 00:55:00,004 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,005 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,005 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 00:55:00,005 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 00:55:00,005 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:00,005 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,005 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:00,007 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,007 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 00:55:00,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,007 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:00,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:00,007 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 00:55:00,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:00,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:00,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:00,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:00,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:00,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 00:55:00,009 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 00:55:00,009 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:00,009 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:00,009 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,009 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:00,011 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,011 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:00,011 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:00,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:00,011 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:00,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,012 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:00,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,015 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,015 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:00,015 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:00,016 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:00,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:00,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 00:55:00,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:55:00,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:00,016 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:00,016 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,016 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:00,016 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:00,016 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,016 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:00,016 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:00,016 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,116 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:00,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:00,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:00,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:00,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,123 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:55:00,123 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:00,123 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 00:55:00,123 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 00:55:00,124 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,124 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,125 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:00,125 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:00,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:00,126 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,126 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:00,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:00,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,126 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,127 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 00:55:00,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 00:55:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 00:55:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:55:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:00,127 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:00,127 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. started... 2023-03-11 00:55:00,127 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 080973ca19275505e5727ec713c114b9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:55:00,541 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907988673bc062f42c6bf54998c4113fdbc to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907988673bc062f42c6bf54998c4113fdbc 2023-03-11 00:55:00,547 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/d4a9ac6cab924682b664a1201acac2ab 2023-03-11 00:55:00,552 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/d4a9ac6cab924682b664a1201acac2ab as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/d4a9ac6cab924682b664a1201acac2ab 2023-03-11 00:55:00,556 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/d4a9ac6cab924682b664a1201acac2ab, entries=1, sequenceid=37, filesize=5.0 K 2023-03-11 00:55:00,557 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 080973ca19275505e5727ec713c114b9 in 430ms, sequenceid=37, compaction requested=true 2023-03-11 00:55:00,557 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:00,557 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:55:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:55:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 00:55:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 00:55:00,558 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,558 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:00,559 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,559 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:00,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 00:55:00,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c58e698[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:00,560 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 00:55:00,560 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,561 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,562 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 00:55:00,562 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 00:55:00,562 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:00,562 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,562 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:00,563 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 00:55:00,563 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,563 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:00,563 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 00:55:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:00,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 00:55:00,565 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 00:55:00,566 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:00,566 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:00,566 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,566 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:00,567 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,567 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,567 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:00,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:00,567 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,568 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:00,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,570 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,570 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:00,570 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,571 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:00,571 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:55:00,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:00,571 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:00,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:00,571 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:00,571 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,571 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,571 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,571 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:00,571 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:00,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:00,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:00,671 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:00,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:00,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:00,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:00,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,677 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:55:00,677 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:00,677 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 00:55:00,677 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 00:55:00,678 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,678 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,679 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,679 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:00,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:00,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:00,679 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:00,679 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:00,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:00,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,680 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,680 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 00:55:00,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:00,680 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 00:55:00,680 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:00,680 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 00:55:00,681 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:55:00,681 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:00,681 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:00,681 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. started... 2023-03-11 00:55:00,681 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 080973ca19275505e5727ec713c114b9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:55:01,094 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205079c999338740fc9aac46e29fb418ca to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511205079c999338740fc9aac46e29fb418ca 2023-03-11 00:55:01,502 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/0d230dd5e10e477e998b76778bec2d26 2023-03-11 00:55:01,507 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/0d230dd5e10e477e998b76778bec2d26 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/0d230dd5e10e477e998b76778bec2d26 2023-03-11 00:55:01,511 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/0d230dd5e10e477e998b76778bec2d26, entries=1, sequenceid=41, filesize=5.0 K 2023-03-11 00:55:01,512 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 080973ca19275505e5727ec713c114b9 in 831ms, sequenceid=41, compaction requested=true 2023-03-11 00:55:01,512 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:01,512 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:55:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:55:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 00:55:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 00:55:01,518 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,518 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:01,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 00:55:01,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40054b1a[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:01,520 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 00:55:01,520 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,524 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,525 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 00:55:01,525 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 00:55:01,525 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,525 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:01,525 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:01,528 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,528 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 00:55:01,529 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:01,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:01,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:01,529 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 00:55:01,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:01,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:01,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:01,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:01,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 00:55:01,531 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 00:55:01,531 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:01,531 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:01,531 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,531 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:01,535 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,535 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:01,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:01,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,535 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:01,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,536 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:01,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:01,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:01,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:01,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,537 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:01,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,541 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,541 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,541 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,541 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:01,541 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 00:55:01,541 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:01,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:01,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:01,541 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,541 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:01,541 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:01,541 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,542 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:01,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:01,542 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:01,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:01,642 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:01,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:01,644 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:01,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 00:55:01,646 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 00:55:01,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:55:01,647 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496701647 2023-03-11 00:55:01,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:55:01,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-11 00:55:01,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:01,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x2384d5db to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:55:01,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78294e84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:55:01,654 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:02,497 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d4a2534343a14b96a2fc50a142a62b5f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103d4a2534343a14b96a2fc50a142a62b5f 2023-03-11 00:55:02,498 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:02,511 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:55:02,512 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43638, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:55:02,519 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:55:02,520 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43134, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:55:02,528 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/852f70ccabbe44dfa9794dae58022d75 first=Optional[r3] last=Optional[r6] 2023-03-11 00:55:02,528 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/852f70ccabbe44dfa9794dae58022d75}] 2023-03-11 00:55:02,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/852f70ccabbe44dfa9794dae58022d75 for inclusion in 080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:55:02,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-11 00:55:02,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:55:02,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:02,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/852f70ccabbe44dfa9794dae58022d75 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fvgc55iod1bq1uh3mo9lu8o8kklgkcakarhuklnv4j9040ems8dkhaatvq41m37l/family1/852f70ccabbe44dfa9794dae58022d75 2023-03-11 00:55:02,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fvgc55iod1bq1uh3mo9lu8o8kklgkcakarhuklnv4j9040ems8dkhaatvq41m37l/family1/852f70ccabbe44dfa9794dae58022d75 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/4a7d61a0d67b44b0ada6a266a31278f7_SeqId_44_ 2023-03-11 00:55:02,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fvgc55iod1bq1uh3mo9lu8o8kklgkcakarhuklnv4j9040ems8dkhaatvq41m37l/family1/852f70ccabbe44dfa9794dae58022d75 into 080973ca19275505e5727ec713c114b9/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/4a7d61a0d67b44b0ada6a266a31278f7_SeqId_44_ - updating store file list. 2023-03-11 00:55:02,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/4a7d61a0d67b44b0ada6a266a31278f7_SeqId_44_ into 080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:55:02,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fvgc55iod1bq1uh3mo9lu8o8kklgkcakarhuklnv4j9040ems8dkhaatvq41m37l/family1/852f70ccabbe44dfa9794dae58022d75 into 080973ca19275505e5727ec713c114b9/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/4a7d61a0d67b44b0ada6a266a31278f7_SeqId_44_) 2023-03-11 00:55:02,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fvgc55iod1bq1uh3mo9lu8o8kklgkcakarhuklnv4j9040ems8dkhaatvq41m37l/family1/852f70ccabbe44dfa9794dae58022d75 2023-03-11 00:55:02,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 00:55:02,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 00:55:02,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 080973ca19275505e5727ec713c114b9/family1 is initiating minor compaction 2023-03-11 00:55:02,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@218b9573; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:55:02,544 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 080973ca19275505e5727ec713c114b9/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:02,545 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8feea2368db64c249843e149ed19ba71, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/7e8175812d4343d882c2b06393ae3f62, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/957cd67e423445c2bd77682eff3ef7ad, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/556b291c8a4946af82f617713e372eb1, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/e6755d1827734c40a942582acac3e5bc, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8f7fb8ed4c3f4325abe533951db3b9aa, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/9ca60b2d5b984a9988ff9563e0240b51, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/d4a9ac6cab924682b664a1201acac2ab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/0d230dd5e10e477e998b76778bec2d26, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/4a7d61a0d67b44b0ada6a266a31278f7_SeqId_44_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp, totalSize=50.3 K 2023-03-11 00:55:02,545 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 8feea2368db64c249843e149ed19ba71, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 00:55:02,545 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 7e8175812d4343d882c2b06393ae3f62, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 00:55:02,545 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 957cd67e423445c2bd77682eff3ef7ad, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 00:55:02,545 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 556b291c8a4946af82f617713e372eb1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 00:55:02,545 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting e6755d1827734c40a942582acac3e5bc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 00:55:02,545 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 8f7fb8ed4c3f4325abe533951db3b9aa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 00:55:02,545 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 9ca60b2d5b984a9988ff9563e0240b51, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 00:55:02,545 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting d4a9ac6cab924682b664a1201acac2ab, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 00:55:02,545 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 0d230dd5e10e477e998b76778bec2d26, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 00:55:02,545 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 4a7d61a0d67b44b0ada6a266a31278f7_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 00:55:02,547 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:02,548 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:02,549 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ba551a12cdc14698a4aba6f39cec8fad to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ba551a12cdc14698a4aba6f39cec8fad 2023-03-11 00:55:02,550 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316df0585fc787404ea8de5be13e4c96d8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316df0585fc787404ea8de5be13e4c96d8 2023-03-11 00:55:02,552 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101eec6fd4ee62c47358ec03e3b3d2db86a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101eec6fd4ee62c47358ec03e3b3d2db86a 2023-03-11 00:55:02,554 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103edba6e2fa4484b5bad527a7cd5268b93 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103edba6e2fa4484b5bad527a7cd5268b93 2023-03-11 00:55:02,554 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-11 00:55:02,554 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-11 00:55:02,554 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:02,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:02,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:02,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:02,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:02,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:02,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:02,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:02,588 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 080973ca19275505e5727ec713c114b9#family1#compaction#71 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:03,402 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/89f3250d56e24d11a5a185ce5f3ec1f0 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/89f3250d56e24d11a5a185ce5f3ec1f0 2023-03-11 00:55:03,406 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 080973ca19275505e5727ec713c114b9/family1 of 080973ca19275505e5727ec713c114b9 into 89f3250d56e24d11a5a185ce5f3ec1f0(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:55:03,406 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:03,406 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678496102544; duration=0sec 2023-03-11 00:55:03,406 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:55:03,408 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e737ad2c17394032a979e048cfbdf4d1 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e737ad2c17394032a979e048cfbdf4d1 2023-03-11 00:55:03,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:03,431 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/018fe7b70e3149fd9abc16ce4922222c first=Optional[r00] last=Optional[r2] 2023-03-11 00:55:03,432 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/018fe7b70e3149fd9abc16ce4922222c}] 2023-03-11 00:55:03,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/018fe7b70e3149fd9abc16ce4922222c for inclusion in 080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:55:03,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-11 00:55:03,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:55:03,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:03,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/018fe7b70e3149fd9abc16ce4922222c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9llio1goc1009b0j3ck761gtsh3653hqc2fb1rublbrrofkum694ir965ijulqkk/family1/018fe7b70e3149fd9abc16ce4922222c 2023-03-11 00:55:03,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9llio1goc1009b0j3ck761gtsh3653hqc2fb1rublbrrofkum694ir965ijulqkk/family1/018fe7b70e3149fd9abc16ce4922222c as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/c76ba153c0ac4fd6be042fe27f4cbe76_SeqId_47_ 2023-03-11 00:55:03,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9llio1goc1009b0j3ck761gtsh3653hqc2fb1rublbrrofkum694ir965ijulqkk/family1/018fe7b70e3149fd9abc16ce4922222c into 080973ca19275505e5727ec713c114b9/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/c76ba153c0ac4fd6be042fe27f4cbe76_SeqId_47_ - updating store file list. 2023-03-11 00:55:03,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/c76ba153c0ac4fd6be042fe27f4cbe76_SeqId_47_ into 080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:55:03,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9llio1goc1009b0j3ck761gtsh3653hqc2fb1rublbrrofkum694ir965ijulqkk/family1/018fe7b70e3149fd9abc16ce4922222c into 080973ca19275505e5727ec713c114b9/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/c76ba153c0ac4fd6be042fe27f4cbe76_SeqId_47_) 2023-03-11 00:55:03,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9llio1goc1009b0j3ck761gtsh3653hqc2fb1rublbrrofkum694ir965ijulqkk/family1/018fe7b70e3149fd9abc16ce4922222c 2023-03-11 00:55:03,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 00:55:03,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 00:55:03,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 080973ca19275505e5727ec713c114b9/family1 is initiating minor compaction (all files) 2023-03-11 00:55:03,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@20204c40; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:55:03,454 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 080973ca19275505e5727ec713c114b9/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:03,455 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/61dcc31fdea24acd8a74ff7980f7d0a7, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/89f3250d56e24d11a5a185ce5f3ec1f0, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/c76ba153c0ac4fd6be042fe27f4cbe76_SeqId_47_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp, totalSize=388.1 K 2023-03-11 00:55:03,457 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 61dcc31fdea24acd8a74ff7980f7d0a7, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839224 2023-03-11 00:55:03,460 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 89f3250d56e24d11a5a185ce5f3ec1f0, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239224 2023-03-11 00:55:03,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8feea2368db64c249843e149ed19ba71, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/7e8175812d4343d882c2b06393ae3f62, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/957cd67e423445c2bd77682eff3ef7ad, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/556b291c8a4946af82f617713e372eb1, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/e6755d1827734c40a942582acac3e5bc, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8f7fb8ed4c3f4325abe533951db3b9aa, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/9ca60b2d5b984a9988ff9563e0240b51, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/d4a9ac6cab924682b664a1201acac2ab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/0d230dd5e10e477e998b76778bec2d26, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/4a7d61a0d67b44b0ada6a266a31278f7_SeqId_44_] to archive 2023-03-11 00:55:03,461 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting c76ba153c0ac4fd6be042fe27f4cbe76_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878839224 2023-03-11 00:55:03,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:03,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8feea2368db64c249843e149ed19ba71 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8feea2368db64c249843e149ed19ba71 2023-03-11 00:55:03,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:03,465 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:03,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/7e8175812d4343d882c2b06393ae3f62 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/7e8175812d4343d882c2b06393ae3f62 2023-03-11 00:55:03,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/957cd67e423445c2bd77682eff3ef7ad to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/957cd67e423445c2bd77682eff3ef7ad 2023-03-11 00:55:03,468 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c65a0e3774ef498780dfa3ba33c41e87 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c65a0e3774ef498780dfa3ba33c41e87 2023-03-11 00:55:03,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/556b291c8a4946af82f617713e372eb1 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/556b291c8a4946af82f617713e372eb1 2023-03-11 00:55:03,469 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b08f5b0a386a4795b6fcd173e9b3c726 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b08f5b0a386a4795b6fcd173e9b3c726 2023-03-11 00:55:03,471 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205707d6ac3df4f4db9bf5ed4ea84e2eca4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205707d6ac3df4f4db9bf5ed4ea84e2eca4 2023-03-11 00:55:03,471 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-11 00:55:03,471 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-11 00:55:03,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:03,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/e6755d1827734c40a942582acac3e5bc to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/e6755d1827734c40a942582acac3e5bc 2023-03-11 00:55:03,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:03,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:55:03,473 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 00:55:03,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8f7fb8ed4c3f4325abe533951db3b9aa to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/8f7fb8ed4c3f4325abe533951db3b9aa 2023-03-11 00:55:03,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8280 sec 2023-03-11 00:55:03,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/9ca60b2d5b984a9988ff9563e0240b51 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/9ca60b2d5b984a9988ff9563e0240b51 2023-03-11 00:55:03,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/d4a9ac6cab924682b664a1201acac2ab to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/d4a9ac6cab924682b664a1201acac2ab 2023-03-11 00:55:03,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/0d230dd5e10e477e998b76778bec2d26 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/0d230dd5e10e477e998b76778bec2d26 2023-03-11 00:55:03,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/4a7d61a0d67b44b0ada6a266a31278f7_SeqId_44_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/4a7d61a0d67b44b0ada6a266a31278f7_SeqId_44_ 2023-03-11 00:55:03,491 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 080973ca19275505e5727ec713c114b9#family1#compaction#72 average throughput is 8.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:03,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-11 00:55:03,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:03,957 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-11 00:55:03,958 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-11 00:55:03,958 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-11 00:55:03,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-11 00:55:03,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, REOPEN/MOVE}] 2023-03-11 00:55:03,963 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, REOPEN/MOVE 2023-03-11 00:55:03,964 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=080973ca19275505e5727ec713c114b9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:03,964 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496103964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496103964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496103964"}]},"ts":"1678496103964"} 2023-03-11 00:55:03,965 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 080973ca19275505e5727ec713c114b9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:04,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:04,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 080973ca19275505e5727ec713c114b9, disabling compactions & flushes 2023-03-11 00:55:04,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:04,722 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/.tmp/family1/600ac12ca07c49a881ee539681728c87 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/600ac12ca07c49a881ee539681728c87 2023-03-11 00:55:04,726 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 080973ca19275505e5727ec713c114b9/family1 of 080973ca19275505e5727ec713c114b9 into 600ac12ca07c49a881ee539681728c87(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:04,726 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:04,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:04,726 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1678496103453; duration=1sec 2023-03-11 00:55:04,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:04,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. after waiting 0 ms 2023-03-11 00:55:04,726 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:55:04,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:04,729 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/61dcc31fdea24acd8a74ff7980f7d0a7, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/89f3250d56e24d11a5a185ce5f3ec1f0, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/c76ba153c0ac4fd6be042fe27f4cbe76_SeqId_47_] to archive 2023-03-11 00:55:04,729 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:04,731 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/61dcc31fdea24acd8a74ff7980f7d0a7 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/61dcc31fdea24acd8a74ff7980f7d0a7 2023-03-11 00:55:04,732 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/89f3250d56e24d11a5a185ce5f3ec1f0 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/89f3250d56e24d11a5a185ce5f3ec1f0 2023-03-11 00:55:04,733 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/c76ba153c0ac4fd6be042fe27f4cbe76_SeqId_47_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/c76ba153c0ac4fd6be042fe27f4cbe76_SeqId_47_ 2023-03-11 00:55:04,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-11 00:55:04,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:04,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:04,738 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 080973ca19275505e5727ec713c114b9 to self. 2023-03-11 00:55:04,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:04,740 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=080973ca19275505e5727ec713c114b9, regionState=CLOSED 2023-03-11 00:55:04,740 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496104739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496104739"}]},"ts":"1678496104739"} 2023-03-11 00:55:04,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-11 00:55:04,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 080973ca19275505e5727ec713c114b9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 776 msec 2023-03-11 00:55:04,742 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=true 2023-03-11 00:55:04,893 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=080973ca19275505e5727ec713c114b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:04,893 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496104893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496104893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496104893"}]},"ts":"1678496104893"} 2023-03-11 00:55:04,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 080973ca19275505e5727ec713c114b9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:05,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:05,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 080973ca19275505e5727ec713c114b9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:55:05,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:05,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:05,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:05,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:05,051 INFO [StoreOpener-080973ca19275505e5727ec713c114b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:05,052 DEBUG [StoreOpener-080973ca19275505e5727ec713c114b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:55:05,052 DEBUG [StoreOpener-080973ca19275505e5727ec713c114b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:55:05,052 INFO [StoreOpener-080973ca19275505e5727ec713c114b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 080973ca19275505e5727ec713c114b9 columnFamilyName family1 2023-03-11 00:55:05,056 DEBUG [StoreOpener-080973ca19275505e5727ec713c114b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/600ac12ca07c49a881ee539681728c87 2023-03-11 00:55:05,056 INFO [StoreOpener-080973ca19275505e5727ec713c114b9-1] regionserver.HStore(310): Store=080973ca19275505e5727ec713c114b9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:05,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9 2023-03-11 00:55:05,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9 2023-03-11 00:55:05,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:05,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 080973ca19275505e5727ec713c114b9; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70172290, jitterRate=0.04564860463142395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:55:05,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:05,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9., pid=63, masterSystemTime=1678496105046 2023-03-11 00:55:05,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:05,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:05,064 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=080973ca19275505e5727ec713c114b9, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:05,064 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496105063"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496105063"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496105063"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496105063"}]},"ts":"1678496105063"} 2023-03-11 00:55:05,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-11 00:55:05,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 080973ca19275505e5727ec713c114b9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 170 msec 2023-03-11 00:55:05,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-11 00:55:05,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, REOPEN/MOVE in 1.1040 sec 2023-03-11 00:55:05,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-11 00:55:05,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1070 sec 2023-03-11 00:55:05,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5240 sec 2023-03-11 00:55:05,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-11 00:55:05,073 INFO [Listener at localhost/45619] compactions.TestMobCompactor(278): alter status finished 2023-03-11 00:55:05,074 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:05,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 00:55:05,075 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 00:55:05,076 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496705076 2023-03-11 00:55:05,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:55:05,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:55:05,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-11 00:55:05,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:05,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x69b6b6a5 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:55:05,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13ddafcd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:55:05,083 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:05,083 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:05,083 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:05,083 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:05,083 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:05,907 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283b4b6305c04c466d97e810f46222013f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511283b4b6305c04c466d97e810f46222013f 2023-03-11 00:55:05,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:05,926 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:55:05,928 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51628, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:55:05,933 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:55:05,935 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52502, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:55:05,943 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d864150ba405499fab60b304208da212 first=Optional[r05] last=Optional[r8] 2023-03-11 00:55:05,943 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=51 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d864150ba405499fab60b304208da212}] 2023-03-11 00:55:05,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d864150ba405499fab60b304208da212 for inclusion in 080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:55:05,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-11 00:55:05,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:55:05,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:05,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d864150ba405499fab60b304208da212 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d5ic8gd166fsin8o6bct75snasab2bvkc5ebd8omgsjiauf1ind0etk4gkbhk8m0/family1/d864150ba405499fab60b304208da212 2023-03-11 00:55:05,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d5ic8gd166fsin8o6bct75snasab2bvkc5ebd8omgsjiauf1ind0etk4gkbhk8m0/family1/d864150ba405499fab60b304208da212 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/51dd4f2702c1415ca86db9d17d63333d_SeqId_53_ 2023-03-11 00:55:05,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d5ic8gd166fsin8o6bct75snasab2bvkc5ebd8omgsjiauf1ind0etk4gkbhk8m0/family1/d864150ba405499fab60b304208da212 into 080973ca19275505e5727ec713c114b9/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/51dd4f2702c1415ca86db9d17d63333d_SeqId_53_ - updating store file list. 2023-03-11 00:55:05,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/51dd4f2702c1415ca86db9d17d63333d_SeqId_53_ into 080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:55:05,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d5ic8gd166fsin8o6bct75snasab2bvkc5ebd8omgsjiauf1ind0etk4gkbhk8m0/family1/d864150ba405499fab60b304208da212 into 080973ca19275505e5727ec713c114b9/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/51dd4f2702c1415ca86db9d17d63333d_SeqId_53_) 2023-03-11 00:55:05,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d5ic8gd166fsin8o6bct75snasab2bvkc5ebd8omgsjiauf1ind0etk4gkbhk8m0/family1/d864150ba405499fab60b304208da212 2023-03-11 00:55:05,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:05,959 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:05,961 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511205079c999338740fc9aac46e29fb418ca to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511205079c999338740fc9aac46e29fb418ca 2023-03-11 00:55:05,962 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112846e13673a2b54effbdd0a01f8e2a47fa to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112846e13673a2b54effbdd0a01f8e2a47fa 2023-03-11 00:55:05,962 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-11 00:55:05,962 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-11 00:55:05,962 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:05,962 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:05,962 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:05,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:05,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:55:05,963 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 00:55:05,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 889 msec 2023-03-11 00:55:06,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-11 00:55:06,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:06,419 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-11 00:55:06,420 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-11 00:55:06,420 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-11 00:55:06,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-11 00:55:06,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, REOPEN/MOVE}] 2023-03-11 00:55:06,425 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, REOPEN/MOVE 2023-03-11 00:55:06,425 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=080973ca19275505e5727ec713c114b9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:06,426 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496106425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496106425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496106425"}]},"ts":"1678496106425"} 2023-03-11 00:55:06,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 080973ca19275505e5727ec713c114b9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:06,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:06,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 080973ca19275505e5727ec713c114b9, disabling compactions & flushes 2023-03-11 00:55:06,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:06,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:06,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. after waiting 0 ms 2023-03-11 00:55:06,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:06,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-11 00:55:06,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:06,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:06,587 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 080973ca19275505e5727ec713c114b9 to self. 2023-03-11 00:55:06,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:06,589 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=080973ca19275505e5727ec713c114b9, regionState=CLOSED 2023-03-11 00:55:06,589 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496106589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496106589"}]},"ts":"1678496106589"} 2023-03-11 00:55:06,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-11 00:55:06,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 080973ca19275505e5727ec713c114b9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 163 msec 2023-03-11 00:55:06,592 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=true 2023-03-11 00:55:06,742 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=080973ca19275505e5727ec713c114b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:06,742 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496106742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496106742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496106742"}]},"ts":"1678496106742"} 2023-03-11 00:55:06,744 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 080973ca19275505e5727ec713c114b9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:06,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:06,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 080973ca19275505e5727ec713c114b9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:55:06,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:06,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:06,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:06,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:06,900 INFO [StoreOpener-080973ca19275505e5727ec713c114b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:06,901 DEBUG [StoreOpener-080973ca19275505e5727ec713c114b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:55:06,901 DEBUG [StoreOpener-080973ca19275505e5727ec713c114b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1 2023-03-11 00:55:06,901 INFO [StoreOpener-080973ca19275505e5727ec713c114b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 080973ca19275505e5727ec713c114b9 columnFamilyName family1 2023-03-11 00:55:06,906 DEBUG [StoreOpener-080973ca19275505e5727ec713c114b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/51dd4f2702c1415ca86db9d17d63333d_SeqId_53_ 2023-03-11 00:55:06,909 DEBUG [StoreOpener-080973ca19275505e5727ec713c114b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/family1/600ac12ca07c49a881ee539681728c87 2023-03-11 00:55:06,909 INFO [StoreOpener-080973ca19275505e5727ec713c114b9-1] regionserver.HStore(310): Store=080973ca19275505e5727ec713c114b9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:06,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9 2023-03-11 00:55:06,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9 2023-03-11 00:55:06,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 080973ca19275505e5727ec713c114b9 2023-03-11 00:55:06,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 080973ca19275505e5727ec713c114b9; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69026068, jitterRate=0.028568565845489502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:55:06,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:55:06,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9., pid=69, masterSystemTime=1678496106895 2023-03-11 00:55:06,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:06,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:55:06,916 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=080973ca19275505e5727ec713c114b9, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:06,916 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678496106915"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496106915"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496106915"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496106915"}]},"ts":"1678496106915"} 2023-03-11 00:55:06,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-11 00:55:06,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 080973ca19275505e5727ec713c114b9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 173 msec 2023-03-11 00:55:06,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-11 00:55:06,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=080973ca19275505e5727ec713c114b9, REOPEN/MOVE in 494 msec 2023-03-11 00:55:06,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-11 00:55:06,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 498 msec 2023-03-11 00:55:06,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 912 msec 2023-03-11 00:55:06,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-11 00:55:06,924 INFO [Listener at localhost/45619] compactions.TestMobCompactor(278): alter status finished 2023-03-11 00:55:06,925 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 00:55:06,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 00:55:06,927 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 00:55:06,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:55:06,928 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496706927 2023-03-11 00:55:06,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:55:06,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-11 00:55:06,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:06,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x2bdc8a57 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:55:06,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2629abe1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:55:06,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:06,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:06,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:06,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:06,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:06,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:06,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:06,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 00:55:06,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 00:55:06,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:55:06,935 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 00:55:06,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-03-11 00:55:06,983 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=238 (was 247), OpenFileDescriptor=615 (was 636), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=183 (was 206), ProcessCount=170 (was 170), AvailableMemoryMB=5471 (was 5547) 2023-03-11 00:55:06,994 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=238, OpenFileDescriptor=615, MaxFileDescriptor=60000, SystemLoadAverage=183, ProcessCount=170, AvailableMemoryMB=5471 2023-03-11 00:55:06,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-11 00:55:06,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-11 00:55:06,999 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:55:06,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-11 00:55:07,000 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:55:07,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 00:55:07,001 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:07,001 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8 empty. 2023-03-11 00:55:07,002 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:07,002 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-11 00:55:07,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 00:55:07,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 00:55:07,414 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-11 00:55:07,416 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => c7f2c57042c17e7cc156a136da40aae8, NAME => 'testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:55:07,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 00:55:07,821 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:07,822 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing c7f2c57042c17e7cc156a136da40aae8, disabling compactions & flushes 2023-03-11 00:55:07,822 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:07,822 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:07,822 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. after waiting 0 ms 2023-03-11 00:55:07,822 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:07,822 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:07,822 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for c7f2c57042c17e7cc156a136da40aae8: 2023-03-11 00:55:07,824 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:55:07,825 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678496107825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496107825"}]},"ts":"1678496107825"} 2023-03-11 00:55:07,826 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 00:55:07,827 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:55:07,827 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496107827"}]},"ts":"1678496107827"} 2023-03-11 00:55:07,828 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-11 00:55:07,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c7f2c57042c17e7cc156a136da40aae8, ASSIGN}] 2023-03-11 00:55:07,832 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c7f2c57042c17e7cc156a136da40aae8, ASSIGN 2023-03-11 00:55:07,833 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=c7f2c57042c17e7cc156a136da40aae8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:55:07,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c7f2c57042c17e7cc156a136da40aae8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:07,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678496107984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496107984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496107984"}]},"ts":"1678496107984"} 2023-03-11 00:55:07,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure c7f2c57042c17e7cc156a136da40aae8, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:08,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 00:55:08,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:08,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7f2c57042c17e7cc156a136da40aae8, NAME => 'testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:55:08,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-11 00:55:08,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-11 00:55:08,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:08,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:08,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:08,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:08,143 INFO [StoreOpener-c7f2c57042c17e7cc156a136da40aae8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:08,144 DEBUG [StoreOpener-c7f2c57042c17e7cc156a136da40aae8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1 2023-03-11 00:55:08,144 DEBUG [StoreOpener-c7f2c57042c17e7cc156a136da40aae8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1 2023-03-11 00:55:08,144 INFO [StoreOpener-c7f2c57042c17e7cc156a136da40aae8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7f2c57042c17e7cc156a136da40aae8 columnFamilyName f1 2023-03-11 00:55:08,146 INFO [StoreOpener-c7f2c57042c17e7cc156a136da40aae8-1] regionserver.HStore(310): Store=c7f2c57042c17e7cc156a136da40aae8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:08,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:08,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:08,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:08,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:55:08,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c7f2c57042c17e7cc156a136da40aae8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58912019, jitterRate=-0.12214250862598419}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:55:08,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c7f2c57042c17e7cc156a136da40aae8: 2023-03-11 00:55:08,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8., pid=73, masterSystemTime=1678496108137 2023-03-11 00:55:08,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:08,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:08,153 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c7f2c57042c17e7cc156a136da40aae8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:08,153 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678496108153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496108153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496108153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496108153"}]},"ts":"1678496108153"} 2023-03-11 00:55:08,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-11 00:55:08,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure c7f2c57042c17e7cc156a136da40aae8, server=jenkins-hbase4.apache.org,38819,1678496016129 in 168 msec 2023-03-11 00:55:08,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-11 00:55:08,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=c7f2c57042c17e7cc156a136da40aae8, ASSIGN in 324 msec 2023-03-11 00:55:08,157 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:55:08,157 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496108157"}]},"ts":"1678496108157"} 2023-03-11 00:55:08,158 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-11 00:55:08,160 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:55:08,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1630 sec 2023-03-11 00:55:09,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 00:55:09,105 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-11 00:55:09,105 DEBUG [Listener at localhost/45619] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-11 00:55:09,107 INFO [Listener at localhost/45619] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-11 00:55:09,110 INFO [Listener at localhost/45619] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-11 00:55:09,110 INFO [Listener at localhost/45619] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-11 00:55:09,110 INFO [Listener at localhost/45619] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-11 00:55:09,114 INFO [Listener at localhost/45619] regionserver.HRegion(2745): Flushing c7f2c57042c17e7cc156a136da40aae8 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-11 00:55:09,526 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031125cb584ebb7342cf80da3b7de0af98d4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031125cb584ebb7342cf80da3b7de0af98d4 2023-03-11 00:55:09,931 INFO [Listener at localhost/45619] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/.tmp/f1/0ace4a1db2e44055af9af19433f70c63 2023-03-11 00:55:09,936 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/.tmp/f1/0ace4a1db2e44055af9af19433f70c63 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63 2023-03-11 00:55:09,939 INFO [Listener at localhost/45619] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63, entries=1, sequenceid=5, filesize=4.9 K 2023-03-11 00:55:09,940 INFO [Listener at localhost/45619] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for c7f2c57042c17e7cc156a136da40aae8 in 826ms, sequenceid=5, compaction requested=false 2023-03-11 00:55:09,940 DEBUG [Listener at localhost/45619] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-11 00:55:09,941 DEBUG [Listener at localhost/45619] regionserver.HRegion(2446): Flush status journal for c7f2c57042c17e7cc156a136da40aae8: 2023-03-11 00:55:09,943 INFO [Listener at localhost/45619] regionserver.HRegion(2745): Flushing c7f2c57042c17e7cc156a136da40aae8 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-11 00:55:10,269 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:55:10,357 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031185f824033aab49a69fc3735fd7f43009 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031185f824033aab49a69fc3735fd7f43009 2023-03-11 00:55:10,762 INFO [Listener at localhost/45619] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/.tmp/f1/21c950689b1a4f9aac223db8c57eadef 2023-03-11 00:55:10,767 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/.tmp/f1/21c950689b1a4f9aac223db8c57eadef as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef 2023-03-11 00:55:10,771 INFO [Listener at localhost/45619] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef, entries=1, sequenceid=9, filesize=4.9 K 2023-03-11 00:55:10,772 INFO [Listener at localhost/45619] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for c7f2c57042c17e7cc156a136da40aae8 in 829ms, sequenceid=9, compaction requested=false 2023-03-11 00:55:10,772 DEBUG [Listener at localhost/45619] regionserver.HRegion(2446): Flush status journal for c7f2c57042c17e7cc156a136da40aae8: 2023-03-11 00:55:10,774 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-11 00:55:10,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-11 00:55:10,776 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-11 00:55:10,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:55:10,776 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496710776 2023-03-11 00:55:10,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 00:55:10,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-11 00:55:10,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-11 00:55:10,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x7cf8619f to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:55:10,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17e5bb42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:55:10,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230311 for table='testGetAfterCompaction' and column='f1' 2023-03-11 00:55:10,825 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:10,825 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:10,876 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:10,876 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:10,927 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:10,927 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:10,978 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:10,978 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,029 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,029 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,080 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,080 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,131 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,131 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,182 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,182 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,232 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,233 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,283 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,284 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,334 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,334 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,385 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,385 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,436 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,436 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,487 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,487 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,538 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,538 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,589 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,589 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,612 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311f7939814c078435286d04905a22afa25 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230311f7939814c078435286d04905a22afa25 2023-03-11 00:55:11,613 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testGetAfterCompaction' column='f1' 2023-03-11 00:55:11,625 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:55:11,627 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51644, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:55:11,632 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:55:11,634 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52512, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:55:11,640 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,640 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,642 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/f1/b321df2e5d4b48edbf852b469a9a03c2 first=Optional[r1] last=Optional[r2] 2023-03-11 00:55:11,642 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{f1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/f1/b321df2e5d4b48edbf852b469a9a03c2}] 2023-03-11 00:55:11,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/f1/b321df2e5d4b48edbf852b469a9a03c2 for inclusion in c7f2c57042c17e7cc156a136da40aae8/f1 2023-03-11 00:55:11,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-11 00:55:11,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:55:11,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for c7f2c57042c17e7cc156a136da40aae8: 2023-03-11 00:55:11,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/f1/b321df2e5d4b48edbf852b469a9a03c2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testGetAfterCompaction__66774cd6h2i5isbjojtirlv1lm3d80s6i04s8cqe3tsiq6n9m6c0fd76aa26ecj4/f1/b321df2e5d4b48edbf852b469a9a03c2 2023-03-11 00:55:11,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testGetAfterCompaction__66774cd6h2i5isbjojtirlv1lm3d80s6i04s8cqe3tsiq6n9m6c0fd76aa26ecj4/f1/b321df2e5d4b48edbf852b469a9a03c2 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_ 2023-03-11 00:55:11,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testGetAfterCompaction__66774cd6h2i5isbjojtirlv1lm3d80s6i04s8cqe3tsiq6n9m6c0fd76aa26ecj4/f1/b321df2e5d4b48edbf852b469a9a03c2 into c7f2c57042c17e7cc156a136da40aae8/f1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_ - updating store file list. 2023-03-11 00:55:11,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_ into c7f2c57042c17e7cc156a136da40aae8/f1 2023-03-11 00:55:11,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testGetAfterCompaction__66774cd6h2i5isbjojtirlv1lm3d80s6i04s8cqe3tsiq6n9m6c0fd76aa26ecj4/f1/b321df2e5d4b48edbf852b469a9a03c2 into c7f2c57042c17e7cc156a136da40aae8/f1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_) 2023-03-11 00:55:11,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testGetAfterCompaction__66774cd6h2i5isbjojtirlv1lm3d80s6i04s8cqe3tsiq6n9m6c0fd76aa26ecj4/f1/b321df2e5d4b48edbf852b469a9a03c2 2023-03-11 00:55:11,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): c7f2c57042c17e7cc156a136da40aae8/f1 is initiating minor compaction 2023-03-11 00:55:11,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1e03df49; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:55:11,655 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c7f2c57042c17e7cc156a136da40aae8/f1 in testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:11,655 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/.tmp, totalSize=10.0 K 2023-03-11 00:55:11,655 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 21c950689b1a4f9aac223db8c57eadef, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 00:55:11,655 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting a87131a78c8148508583bc748c65b94d_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 00:55:11,657 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testGetAfterCompaction' column='f1' 2023-03-11 00:55:11,657 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:11,659 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031125cb584ebb7342cf80da3b7de0af98d4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031125cb584ebb7342cf80da3b7de0af98d4 2023-03-11 00:55:11,660 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031185f824033aab49a69fc3735fd7f43009 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031185f824033aab49a69fc3735fd7f43009 2023-03-11 00:55:11,660 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-11 00:55:11,660 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230311' 2023-03-11 00:55:11,660 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230311 for table='testGetAfterCompaction' and column='f1' 2023-03-11 00:55:11,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-11 00:55:11,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:55:11,662 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-11 00:55:11,662 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): c7f2c57042c17e7cc156a136da40aae8#f1#compaction#75 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:11,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 888 msec 2023-03-11 00:55:11,691 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,691 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,691 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:11,695 DEBUG [Listener at localhost/45619] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-11 00:55:11,698 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51648, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-11 00:55:11,698 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38819] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:11,699 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-11 00:55:11,699 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-11 00:55:11,699 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38819] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-11 00:55:11,699 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38819] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. because compaction request was cancelled 2023-03-11 00:55:11,751 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,751 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,751 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:11,802 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,802 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,802 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:11,853 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,853 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,853 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:11,904 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,904 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,904 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:11,955 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,955 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:11,955 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,006 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,006 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,006 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,057 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,057 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,057 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,108 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,108 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,108 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,159 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,159 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,159 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,210 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,210 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,210 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,260 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,261 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,261 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,311 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,312 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,312 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,362 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,362 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,363 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,413 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,413 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,413 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,464 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,464 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,464 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,475 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/.tmp/f1/b2cb63d9c79643ec992bf750a7a99432 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/b2cb63d9c79643ec992bf750a7a99432 2023-03-11 00:55:12,479 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in c7f2c57042c17e7cc156a136da40aae8/f1 of c7f2c57042c17e7cc156a136da40aae8 into b2cb63d9c79643ec992bf750a7a99432(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:55:12,479 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c7f2c57042c17e7cc156a136da40aae8: 2023-03-11 00:55:12,479 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1678496111655; duration=0sec 2023-03-11 00:55:12,479 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:55:12,515 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,515 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496110762; access_time=1678496109944; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,515 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678496111608; access_time=1678496110794; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 00:55:12,516 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/b2cb63d9c79643ec992bf750a7a99432; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678496112471; access_time=1678496111659; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_] to archive 2023-03-11 00:55:12,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:12,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/21c950689b1a4f9aac223db8c57eadef 2023-03-11 00:55:12,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/a87131a78c8148508583bc748c65b94d_SeqId_12_ 2023-03-11 00:55:12,566 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678496109930; access_time=1678496109117; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,566 INFO [Listener at localhost/45619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/b2cb63d9c79643ec992bf750a7a99432; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678496112471; access_time=1678496111659; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 00:55:12,682 INFO [Listener at localhost/45619] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-11 00:55:12,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-03-11 00:55:12,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-11 00:55:12,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496112694"}]},"ts":"1678496112694"} 2023-03-11 00:55:12,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-11 00:55:12,695 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-11 00:55:12,698 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-11 00:55:12,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c7f2c57042c17e7cc156a136da40aae8, UNASSIGN}] 2023-03-11 00:55:12,700 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c7f2c57042c17e7cc156a136da40aae8, UNASSIGN 2023-03-11 00:55:12,701 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c7f2c57042c17e7cc156a136da40aae8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:12,701 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678496112701"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496112701"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496112701"}]},"ts":"1678496112701"} 2023-03-11 00:55:12,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure c7f2c57042c17e7cc156a136da40aae8, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:12,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-11 00:55:12,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:12,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c7f2c57042c17e7cc156a136da40aae8, disabling compactions & flushes 2023-03-11 00:55:12,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:12,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:12,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. after waiting 0 ms 2023-03-11 00:55:12,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:12,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-11 00:55:12,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-11 00:55:12,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8. 2023-03-11 00:55:12,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c7f2c57042c17e7cc156a136da40aae8: 2023-03-11 00:55:12,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:12,862 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c7f2c57042c17e7cc156a136da40aae8, regionState=CLOSED 2023-03-11 00:55:12,862 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678496112862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496112862"}]},"ts":"1678496112862"} 2023-03-11 00:55:12,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-11 00:55:12,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure c7f2c57042c17e7cc156a136da40aae8, server=jenkins-hbase4.apache.org,38819,1678496016129 in 161 msec 2023-03-11 00:55:12,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-11 00:55:12,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=c7f2c57042c17e7cc156a136da40aae8, UNASSIGN in 165 msec 2023-03-11 00:55:12,866 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496112866"}]},"ts":"1678496112866"} 2023-03-11 00:55:12,867 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-11 00:55:12,871 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-11 00:55:12,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 184 msec 2023-03-11 00:55:12,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-11 00:55:12,997 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-11 00:55:13,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-03-11 00:55:13,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 00:55:13,009 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 00:55:13,010 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 00:55:13,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-11 00:55:13,013 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:13,015 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1, FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/recovered.edits] 2023-03-11 00:55:13,018 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/0ace4a1db2e44055af9af19433f70c63 2023-03-11 00:55:13,019 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/b2cb63d9c79643ec992bf750a7a99432 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/f1/b2cb63d9c79643ec992bf750a7a99432 2023-03-11 00:55:13,022 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/recovered.edits/15.seqid to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8/recovered.edits/15.seqid 2023-03-11 00:55:13,022 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testGetAfterCompaction/c7f2c57042c17e7cc156a136da40aae8 2023-03-11 00:55:13,022 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-11 00:55:13,023 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-11 00:55:13,023 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-11 00:55:13,026 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230311f7939814c078435286d04905a22afa25 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230311f7939814c078435286d04905a22afa25 2023-03-11 00:55:13,027 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-11 00:55:13,029 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 00:55:13,050 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-11 00:55:13,052 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-11 00:55:13,053 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 00:55:13,053 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-11 00:55:13,054 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678496113054"}]},"ts":"9223372036854775807"} 2023-03-11 00:55:13,055 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-11 00:55:13,055 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c7f2c57042c17e7cc156a136da40aae8, NAME => 'testGetAfterCompaction,,1678496106997.c7f2c57042c17e7cc156a136da40aae8.', STARTKEY => '', ENDKEY => ''}] 2023-03-11 00:55:13,055 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-11 00:55:13,055 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1678496113055"}]},"ts":"9223372036854775807"} 2023-03-11 00:55:13,057 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-11 00:55:13,058 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 00:55:13,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 55 msec 2023-03-11 00:55:13,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-11 00:55:13,113 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-11 00:55:13,127 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=244 (was 238) - Thread LEAK? -, OpenFileDescriptor=615 (was 615), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 183), ProcessCount=170 (was 170), AvailableMemoryMB=5465 (was 5471) 2023-03-11 00:55:13,139 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=244, OpenFileDescriptor=615, MaxFileDescriptor=60000, SystemLoadAverage=176, ProcessCount=170, AvailableMemoryMB=5464 2023-03-11 00:55:13,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-11 00:55:13,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-11 00:55:13,143 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:55:13,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-11 00:55:13,144 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:55:13,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 00:55:13,146 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:13,146 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:13,146 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:13,146 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982 empty. 2023-03-11 00:55:13,146 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9 empty. 2023-03-11 00:55:13,146 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9 empty. 2023-03-11 00:55:13,147 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:13,147 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:13,147 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:13,147 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-11 00:55:13,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 00:55:13,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 00:55:13,555 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-11 00:55:13,556 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 053e1f32f2dd2afeb0e5696a70cb7982, NAME => 'testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:55:13,556 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6f70d0cb8cdfe50a22b0232bd3d5c5b9, NAME => 'testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:55:13,556 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 186abf08f502dabd8577259d44f7d8d9, NAME => 'testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:55:13,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 00:55:13,970 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:13,970 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 053e1f32f2dd2afeb0e5696a70cb7982, disabling compactions & flushes 2023-03-11 00:55:13,970 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:13,970 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:13,970 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. after waiting 0 ms 2023-03-11 00:55:13,970 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:13,970 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:13,970 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 186abf08f502dabd8577259d44f7d8d9, disabling compactions & flushes 2023-03-11 00:55:13,974 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. after waiting 0 ms 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 6f70d0cb8cdfe50a22b0232bd3d5c5b9, disabling compactions & flushes 2023-03-11 00:55:13,974 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:13,974 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. after waiting 0 ms 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:13,974 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:13,974 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:13,976 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:55:13,977 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496113977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496113977"}]},"ts":"1678496113977"} 2023-03-11 00:55:13,978 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496113977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496113977"}]},"ts":"1678496113977"} 2023-03-11 00:55:13,978 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496113977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496113977"}]},"ts":"1678496113977"} 2023-03-11 00:55:13,980 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-11 00:55:13,980 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:55:13,981 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496113980"}]},"ts":"1678496113980"} 2023-03-11 00:55:13,982 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-11 00:55:13,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, ASSIGN}] 2023-03-11 00:55:13,988 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, ASSIGN 2023-03-11 00:55:13,988 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, ASSIGN 2023-03-11 00:55:13,988 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, ASSIGN 2023-03-11 00:55:13,988 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:55:13,989 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:55:13,989 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:55:14,140 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=053e1f32f2dd2afeb0e5696a70cb7982, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:14,140 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6f70d0cb8cdfe50a22b0232bd3d5c5b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:14,140 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=186abf08f502dabd8577259d44f7d8d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:14,140 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496114140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496114140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496114140"}]},"ts":"1678496114140"} 2023-03-11 00:55:14,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496114140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496114140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496114140"}]},"ts":"1678496114140"} 2023-03-11 00:55:14,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496114140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496114140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496114140"}]},"ts":"1678496114140"} 2023-03-11 00:55:14,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 053e1f32f2dd2afeb0e5696a70cb7982, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:14,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure 6f70d0cb8cdfe50a22b0232bd3d5c5b9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:14,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 186abf08f502dabd8577259d44f7d8d9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:14,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 00:55:14,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:14,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f70d0cb8cdfe50a22b0232bd3d5c5b9, NAME => 'testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.', STARTKEY => '1', ENDKEY => '2'} 2023-03-11 00:55:14,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:14,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:14,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:14,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:14,300 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:14,301 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 2023-03-11 00:55:14,301 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 2023-03-11 00:55:14,302 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f70d0cb8cdfe50a22b0232bd3d5c5b9 columnFamilyName family1 2023-03-11 00:55:14,303 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(310): Store=6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:14,304 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:14,305 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2 2023-03-11 00:55:14,305 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2 2023-03-11 00:55:14,305 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f70d0cb8cdfe50a22b0232bd3d5c5b9 columnFamilyName family2 2023-03-11 00:55:14,307 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(310): Store=6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:14,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:14,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:14,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:55:14,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:14,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:55:14,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f70d0cb8cdfe50a22b0232bd3d5c5b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64538572, jitterRate=-0.03830033540725708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:55:14,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:14,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9., pid=84, masterSystemTime=1678496114295 2023-03-11 00:55:14,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:14,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:14,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:14,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 053e1f32f2dd2afeb0e5696a70cb7982, NAME => 'testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.', STARTKEY => '', ENDKEY => '1'} 2023-03-11 00:55:14,314 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6f70d0cb8cdfe50a22b0232bd3d5c5b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:14,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:14,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:14,315 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496114314"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496114314"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496114314"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496114314"}]},"ts":"1678496114314"} 2023-03-11 00:55:14,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:14,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:14,316 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:14,317 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1 2023-03-11 00:55:14,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-03-11 00:55:14,317 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1 2023-03-11 00:55:14,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure 6f70d0cb8cdfe50a22b0232bd3d5c5b9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 173 msec 2023-03-11 00:55:14,317 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 053e1f32f2dd2afeb0e5696a70cb7982 columnFamilyName family1 2023-03-11 00:55:14,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, ASSIGN in 332 msec 2023-03-11 00:55:14,318 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(310): Store=053e1f32f2dd2afeb0e5696a70cb7982/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:14,319 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:14,320 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2 2023-03-11 00:55:14,320 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2 2023-03-11 00:55:14,320 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 053e1f32f2dd2afeb0e5696a70cb7982 columnFamilyName family2 2023-03-11 00:55:14,321 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(310): Store=053e1f32f2dd2afeb0e5696a70cb7982/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:14,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:14,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:14,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:55:14,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:14,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:55:14,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 053e1f32f2dd2afeb0e5696a70cb7982; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70970464, jitterRate=0.05754232406616211}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:55:14,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:14,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982., pid=83, masterSystemTime=1678496114295 2023-03-11 00:55:14,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:14,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:14,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:14,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 186abf08f502dabd8577259d44f7d8d9, NAME => 'testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.', STARTKEY => '2', ENDKEY => ''} 2023-03-11 00:55:14,330 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=053e1f32f2dd2afeb0e5696a70cb7982, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:14,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:14,330 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496114330"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496114330"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496114330"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496114330"}]},"ts":"1678496114330"} 2023-03-11 00:55:14,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:14,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:14,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:14,331 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:14,333 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1 2023-03-11 00:55:14,333 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1 2023-03-11 00:55:14,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-03-11 00:55:14,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 053e1f32f2dd2afeb0e5696a70cb7982, server=jenkins-hbase4.apache.org,38819,1678496016129 in 189 msec 2023-03-11 00:55:14,333 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 186abf08f502dabd8577259d44f7d8d9 columnFamilyName family1 2023-03-11 00:55:14,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, ASSIGN in 348 msec 2023-03-11 00:55:14,334 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(310): Store=186abf08f502dabd8577259d44f7d8d9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:14,334 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:14,335 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2 2023-03-11 00:55:14,335 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2 2023-03-11 00:55:14,336 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 186abf08f502dabd8577259d44f7d8d9 columnFamilyName family2 2023-03-11 00:55:14,337 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(310): Store=186abf08f502dabd8577259d44f7d8d9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:14,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:14,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:14,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:55:14,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:14,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:55:14,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 186abf08f502dabd8577259d44f7d8d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62226758, jitterRate=-0.0727490484714508}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:55:14,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:14,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9., pid=85, masterSystemTime=1678496114295 2023-03-11 00:55:14,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:14,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:14,348 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=186abf08f502dabd8577259d44f7d8d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:14,348 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496114348"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496114348"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496114348"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496114348"}]},"ts":"1678496114348"} 2023-03-11 00:55:14,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-03-11 00:55:14,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 186abf08f502dabd8577259d44f7d8d9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 206 msec 2023-03-11 00:55:14,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=79 2023-03-11 00:55:14,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, ASSIGN in 365 msec 2023-03-11 00:55:14,353 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:55:14,353 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496114353"}]},"ts":"1678496114353"} 2023-03-11 00:55:14,354 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-11 00:55:14,356 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:55:14,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2160 sec 2023-03-11 00:55:15,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 00:55:15,249 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-11 00:55:15,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:15,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:15,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:15,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:15,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-11 00:55:15,265 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-11 00:55:15,265 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:15,265 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-11 00:55:15,265 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-11 00:55:15,266 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:15,266 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:15,267 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:15,267 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:15,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:15,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:15,267 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:15,267 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:15,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:15,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:15,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:15,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:15,268 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-11 00:55:15,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-11 00:55:15,268 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-11 00:55:15,268 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:15,268 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-11 00:55:15,268 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:15,268 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:15,268 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:55:15,269 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:15,269 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. started... 2023-03-11 00:55:15,269 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:15,269 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. started... 2023-03-11 00:55:15,269 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 053e1f32f2dd2afeb0e5696a70cb7982 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 00:55:15,269 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. started... 2023-03-11 00:55:15,270 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 186abf08f502dabd8577259d44f7d8d9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 00:55:15,270 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 00:55:15,287 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303116b231f2776864a47b304ed986ae2eb33 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303116b231f2776864a47b304ed986ae2eb33 2023-03-11 00:55:15,288 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311cb982ae2531e4cfca4d434fef9a98b95 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311cb982ae2531e4cfca4d434fef9a98b95 2023-03-11 00:55:15,688 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311efb20048b83f4aaa9ede919244a03f0b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311efb20048b83f4aaa9ede919244a03f0b 2023-03-11 00:55:15,697 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/548570c7c5334fb59847e65505210396 2023-03-11 00:55:15,697 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/eadd8a5089914a5a961a28d9a005faab 2023-03-11 00:55:16,093 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/956c50b8ec45442594956fb9ad279eb9 2023-03-11 00:55:16,118 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311d771b112cbe84b518ca8ff6943ce0429 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311d771b112cbe84b518ca8ff6943ce0429 2023-03-11 00:55:16,118 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303116b34e4fffa8b43759aa4a2d04ce43d24 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303116b34e4fffa8b43759aa4a2d04ce43d24 2023-03-11 00:55:16,507 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311af5d2ec28a8946b39d4919ce1b65fd2a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311af5d2ec28a8946b39d4919ce1b65fd2a 2023-03-11 00:55:16,523 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/bdd52f8480e342c99155883d20fd5ec0 2023-03-11 00:55:16,523 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/033d4a06f89f4f64a5d06136bdd18fe4 2023-03-11 00:55:16,527 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/eadd8a5089914a5a961a28d9a005faab as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/eadd8a5089914a5a961a28d9a005faab 2023-03-11 00:55:16,527 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/548570c7c5334fb59847e65505210396 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/548570c7c5334fb59847e65505210396 2023-03-11 00:55:16,530 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/eadd8a5089914a5a961a28d9a005faab, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 00:55:16,530 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/548570c7c5334fb59847e65505210396, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 00:55:16,531 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/033d4a06f89f4f64a5d06136bdd18fe4 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/033d4a06f89f4f64a5d06136bdd18fe4 2023-03-11 00:55:16,531 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/bdd52f8480e342c99155883d20fd5ec0 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/bdd52f8480e342c99155883d20fd5ec0 2023-03-11 00:55:16,535 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/033d4a06f89f4f64a5d06136bdd18fe4, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 00:55:16,535 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/bdd52f8480e342c99155883d20fd5ec0, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 00:55:16,535 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 186abf08f502dabd8577259d44f7d8d9 in 1265ms, sequenceid=5, compaction requested=false 2023-03-11 00:55:16,536 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-11 00:55:16,536 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 in 1266ms, sequenceid=5, compaction requested=false 2023-03-11 00:55:16,536 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-11 00:55:16,536 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:16,537 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:16,537 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:16,537 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:16,537 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:55:16,537 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:55:16,913 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/285d642b34a14520997143c089e64610 2023-03-11 00:55:16,917 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/956c50b8ec45442594956fb9ad279eb9 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/956c50b8ec45442594956fb9ad279eb9 2023-03-11 00:55:16,921 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/956c50b8ec45442594956fb9ad279eb9, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 00:55:16,921 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/285d642b34a14520997143c089e64610 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/285d642b34a14520997143c089e64610 2023-03-11 00:55:16,925 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/285d642b34a14520997143c089e64610, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 00:55:16,926 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 053e1f32f2dd2afeb0e5696a70cb7982 in 1657ms, sequenceid=5, compaction requested=false 2023-03-11 00:55:16,926 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:16,926 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:16,926 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:55:16,926 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:55:16,926 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,926 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-11 00:55:16,926 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-11 00:55:16,928 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,928 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:16,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:16,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:16,928 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:16,928 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:16,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:16,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:16,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:16,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:16,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-11 00:55:16,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@135f5262[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:16,929 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-11 00:55:16,929 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:16,931 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:16,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:16,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:16,931 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-11 00:55:16,931 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-11 00:55:16,931 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:16,931 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,931 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:16,932 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-11 00:55:16,932 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,932 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:16,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:16,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:16,932 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-11 00:55:16,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:16,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:16,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:16,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:16,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:16,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:16,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-11 00:55:16,935 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-11 00:55:16,935 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:16,935 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:16,935 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-11 00:55:16,935 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:16,937 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:16,937 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:16,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:16,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:16,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:16,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:16,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:16,937 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:16,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:16,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:16,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:16,937 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:16,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:16,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:16,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:16,938 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:16,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:16,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:16,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-11 00:55:16,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:16,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:16,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:16,941 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:16,941 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:17,041 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:17,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:17,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:17,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:17,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:17,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:17,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:17,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-11 00:55:17,049 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-11 00:55:17,049 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:17,049 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-11 00:55:17,049 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-11 00:55:17,049 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:17,049 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:17,051 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:17,051 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:17,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:17,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:17,051 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:17,051 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:17,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:17,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:17,052 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-11 00:55:17,052 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-11 00:55:17,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-11 00:55:17,052 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-11 00:55:17,052 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:17,052 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-11 00:55:17,052 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:17,052 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. started... 2023-03-11 00:55:17,053 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 186abf08f502dabd8577259d44f7d8d9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 00:55:17,056 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:17,056 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. started... 2023-03-11 00:55:17,056 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 053e1f32f2dd2afeb0e5696a70cb7982 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 00:55:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:55:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:17,056 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:17,056 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. started... 2023-03-11 00:55:17,056 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 00:55:17,078 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311256343a0c4764e11abff441b975d0033 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311256343a0c4764e11abff441b975d0033 2023-03-11 00:55:17,479 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303115756febdcdbf4b999de7cd8c523988c5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303115756febdcdbf4b999de7cd8c523988c5 2023-03-11 00:55:17,480 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311638b71312f27478ba384c343cf242e18 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311638b71312f27478ba384c343cf242e18 2023-03-11 00:55:17,483 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/9c8d3bc701894145b03f6c3228555de4 2023-03-11 00:55:17,898 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/aa7feaf1facf454faa04e8e49998ccf5 2023-03-11 00:55:17,900 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/29002ac597984b53a8b5902b72f6c8ab 2023-03-11 00:55:17,905 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303116dde902809b946dd9dddab7705399133 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303116dde902809b946dd9dddab7705399133 2023-03-11 00:55:17,925 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031103814fb7c7854958824ece9b59717af7 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031103814fb7c7854958824ece9b59717af7 2023-03-11 00:55:18,321 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/0c0c40ea072d47408a7453d9582e974a 2023-03-11 00:55:18,325 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311df485881b5834a069bc87062a3775512 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311df485881b5834a069bc87062a3775512 2023-03-11 00:55:18,325 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/9c8d3bc701894145b03f6c3228555de4 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/9c8d3bc701894145b03f6c3228555de4 2023-03-11 00:55:18,329 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/9c8d3bc701894145b03f6c3228555de4, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 00:55:18,330 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/4be93ac838e045d9975d05c62464ace6 2023-03-11 00:55:18,330 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/0c0c40ea072d47408a7453d9582e974a as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0c0c40ea072d47408a7453d9582e974a 2023-03-11 00:55:18,334 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/29002ac597984b53a8b5902b72f6c8ab as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/29002ac597984b53a8b5902b72f6c8ab 2023-03-11 00:55:18,334 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0c0c40ea072d47408a7453d9582e974a, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 00:55:18,335 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 186abf08f502dabd8577259d44f7d8d9 in 1283ms, sequenceid=9, compaction requested=false 2023-03-11 00:55:18,335 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:18,335 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:18,335 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:55:18,337 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/29002ac597984b53a8b5902b72f6c8ab, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 00:55:18,338 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/4be93ac838e045d9975d05c62464ace6 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/4be93ac838e045d9975d05c62464ace6 2023-03-11 00:55:18,341 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/4be93ac838e045d9975d05c62464ace6, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 00:55:18,342 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 053e1f32f2dd2afeb0e5696a70cb7982 in 1286ms, sequenceid=9, compaction requested=false 2023-03-11 00:55:18,342 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:18,342 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:18,342 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:55:18,361 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:55:18,731 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/10f422db8f8e4ea58b30f09f7ccb669a 2023-03-11 00:55:18,735 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/aa7feaf1facf454faa04e8e49998ccf5 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/aa7feaf1facf454faa04e8e49998ccf5 2023-03-11 00:55:18,738 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/aa7feaf1facf454faa04e8e49998ccf5, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 00:55:18,739 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/10f422db8f8e4ea58b30f09f7ccb669a as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/10f422db8f8e4ea58b30f09f7ccb669a 2023-03-11 00:55:18,744 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/10f422db8f8e4ea58b30f09f7ccb669a, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 00:55:18,745 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 in 1689ms, sequenceid=9, compaction requested=false 2023-03-11 00:55:18,745 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:18,745 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:18,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:55:18,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:55:18,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-11 00:55:18,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-11 00:55:18,746 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,746 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:18,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:18,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:18,747 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:18,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:18,747 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:18,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:18,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:18,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-11 00:55:18,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1052ce41[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:18,748 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-11 00:55:18,748 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:18,750 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:18,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:18,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:18,751 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-11 00:55:18,751 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-11 00:55:18,751 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:18,751 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,751 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:18,752 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-11 00:55:18,752 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,752 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:18,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,752 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-11 00:55:18,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:18,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:18,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:18,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:18,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:18,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-11 00:55:18,754 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-11 00:55:18,754 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:18,754 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:18,754 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-11 00:55:18,754 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:18,756 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:18,756 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:18,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:18,756 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:18,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:18,757 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:18,758 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,760 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,760 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:18,760 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:18,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:18,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-11 00:55:18,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:18,760 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:18,760 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:18,760 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:18,760 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:18,760 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:18,760 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:18,760 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:18,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:18,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:18,761 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:18,761 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:18,861 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:18,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:18,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:18,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:18,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:18,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:18,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:18,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-11 00:55:18,867 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-11 00:55:18,867 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:18,867 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-11 00:55:18,867 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-11 00:55:18,868 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:18,868 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:18,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:18,870 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:18,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:18,870 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:18,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:18,871 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:18,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:18,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:18,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:18,871 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-11 00:55:18,871 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-11 00:55:18,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-11 00:55:18,871 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-11 00:55:18,871 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:18,872 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-11 00:55:18,872 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:18,872 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. started... 2023-03-11 00:55:18,872 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:18,872 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:55:18,872 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 186abf08f502dabd8577259d44f7d8d9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 00:55:18,872 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:18,872 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. started... 2023-03-11 00:55:18,872 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. started... 2023-03-11 00:55:18,872 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:18,872 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 053e1f32f2dd2afeb0e5696a70cb7982 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 00:55:18,872 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 00:55:19,299 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311e21b6d88f9724146a471b5550c202143 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311e21b6d88f9724146a471b5550c202143 2023-03-11 00:55:19,300 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311ace8c856047e4bb3adccbb4fa0d55303 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311ace8c856047e4bb3adccbb4fa0d55303 2023-03-11 00:55:19,302 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311690081347528497b9fa16b2a8dd62a2d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311690081347528497b9fa16b2a8dd62a2d 2023-03-11 00:55:19,309 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/098a99876ba04417bee017780510c171 2023-03-11 00:55:19,312 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/46813adbc92b49c58b4fc1a74dcbdd46 2023-03-11 00:55:19,323 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311d90c242ddc50494b9adb99bfd44e9159 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311d90c242ddc50494b9adb99bfd44e9159 2023-03-11 00:55:19,709 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/4f688fd0b53848159bbc6f2b34605b52 2023-03-11 00:55:19,724 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031119aede9012a34c3298d6b2cd05d14e4a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031119aede9012a34c3298d6b2cd05d14e4a 2023-03-11 00:55:19,728 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/dbf45db339b14dce93ddb4c1fafb1d72 2023-03-11 00:55:19,728 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/fa29a3dc78264d2f9ff001bf31239001 2023-03-11 00:55:19,731 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/098a99876ba04417bee017780510c171 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/098a99876ba04417bee017780510c171 2023-03-11 00:55:19,732 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/46813adbc92b49c58b4fc1a74dcbdd46 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/46813adbc92b49c58b4fc1a74dcbdd46 2023-03-11 00:55:19,735 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/098a99876ba04417bee017780510c171, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 00:55:19,735 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/46813adbc92b49c58b4fc1a74dcbdd46, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 00:55:19,736 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/fa29a3dc78264d2f9ff001bf31239001 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/fa29a3dc78264d2f9ff001bf31239001 2023-03-11 00:55:19,736 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/dbf45db339b14dce93ddb4c1fafb1d72 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/dbf45db339b14dce93ddb4c1fafb1d72 2023-03-11 00:55:19,739 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/fa29a3dc78264d2f9ff001bf31239001, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 00:55:19,739 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/dbf45db339b14dce93ddb4c1fafb1d72, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 00:55:19,740 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 053e1f32f2dd2afeb0e5696a70cb7982 in 868ms, sequenceid=13, compaction requested=true 2023-03-11 00:55:19,740 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 186abf08f502dabd8577259d44f7d8d9 in 868ms, sequenceid=13, compaction requested=true 2023-03-11 00:55:19,740 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:19,740 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:19,740 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:19,740 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:19,740 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:55:19,740 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:55:20,125 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031170336f9451a4452583516331530ef145 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031170336f9451a4452583516331530ef145 2023-03-11 00:55:20,532 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/3575de3147bd411b802b9b9bfdf3b93c 2023-03-11 00:55:20,536 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/4f688fd0b53848159bbc6f2b34605b52 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/4f688fd0b53848159bbc6f2b34605b52 2023-03-11 00:55:20,539 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/4f688fd0b53848159bbc6f2b34605b52, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 00:55:20,540 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/3575de3147bd411b802b9b9bfdf3b93c as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/3575de3147bd411b802b9b9bfdf3b93c 2023-03-11 00:55:20,543 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/3575de3147bd411b802b9b9bfdf3b93c, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 00:55:20,544 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 in 1672ms, sequenceid=13, compaction requested=true 2023-03-11 00:55:20,544 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:20,544 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:20,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:55:20,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:55:20,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-11 00:55:20,544 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-11 00:55:20,546 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,546 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:20,546 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:20,546 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:20,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-11 00:55:20,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b8586f5[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:20,548 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-11 00:55:20,548 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:20,549 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:20,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:20,549 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,549 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-11 00:55:20,549 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-11 00:55:20,549 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:20,549 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:20,550 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,550 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-11 00:55:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:20,550 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:20,550 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-11 00:55:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:20,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-11 00:55:20,552 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-11 00:55:20,553 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:20,553 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:20,553 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-11 00:55:20,553 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:20,558 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:20,558 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:20,558 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:20,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:20,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:20,558 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:20,559 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:20,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:20,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,561 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,561 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:20,561 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:20,561 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:20,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-11 00:55:20,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:20,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:20,561 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:20,561 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:20,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:20,561 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-11 00:55:20,562 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:20,562 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:20,562 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:20,562 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:20,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:20,562 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:20,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:20,662 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:20,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:20,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:20,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:20,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:20,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:20,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:20,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-11 00:55:20,668 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-11 00:55:20,668 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:20,668 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-11 00:55:20,669 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-11 00:55:20,669 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:20,669 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:20,670 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,670 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:20,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:20,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:20,670 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:20,670 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:20,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:20,671 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-11 00:55:20,671 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-11 00:55:20,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-11 00:55:20,672 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-11 00:55:20,672 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:20,672 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-11 00:55:20,672 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:20,672 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. started... 2023-03-11 00:55:20,672 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 186abf08f502dabd8577259d44f7d8d9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 00:55:20,675 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:20,675 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:55:20,675 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:20,675 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. started... 2023-03-11 00:55:20,675 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:20,675 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. started... 2023-03-11 00:55:20,676 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 053e1f32f2dd2afeb0e5696a70cb7982 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 00:55:20,676 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 00:55:21,098 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031191c5858b6023453698850b6c07d3b7bb to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031191c5858b6023453698850b6c07d3b7bb 2023-03-11 00:55:21,104 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/2c3e11681c55425fab6a7ddf1913ff08 2023-03-11 00:55:21,104 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303112ebe3904fa1846a3ac2f07fb4dbdbfbd to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112ebe3904fa1846a3ac2f07fb4dbdbfbd 2023-03-11 00:55:21,104 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303110bce642178f448eab384eb7a61cb329b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303110bce642178f448eab384eb7a61cb329b 2023-03-11 00:55:21,110 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/1d2766c176504303aa587bb83f179d04 2023-03-11 00:55:21,110 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/30953997ca7a4d23913d0acc8eff85fd 2023-03-11 00:55:21,128 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031130bad12ed48f4a0b93bf813aa2fc17c6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031130bad12ed48f4a0b93bf813aa2fc17c6 2023-03-11 00:55:21,520 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311d252dc6217a949d3bd9460994141073f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311d252dc6217a949d3bd9460994141073f 2023-03-11 00:55:21,525 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303116a0cada6b3b147789d1469d62b0634c2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303116a0cada6b3b147789d1469d62b0634c2 2023-03-11 00:55:21,530 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/2af7267f1d6b4641ba22df7cb36238f9 2023-03-11 00:55:21,534 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/30953997ca7a4d23913d0acc8eff85fd as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/30953997ca7a4d23913d0acc8eff85fd 2023-03-11 00:55:21,536 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/0bc99884f1864d9bbbd65f159febcea4 2023-03-11 00:55:21,538 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/30953997ca7a4d23913d0acc8eff85fd, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 00:55:21,539 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/2af7267f1d6b4641ba22df7cb36238f9 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/2af7267f1d6b4641ba22df7cb36238f9 2023-03-11 00:55:21,541 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/1d2766c176504303aa587bb83f179d04 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/1d2766c176504303aa587bb83f179d04 2023-03-11 00:55:21,544 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/2af7267f1d6b4641ba22df7cb36238f9, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 00:55:21,545 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 053e1f32f2dd2afeb0e5696a70cb7982 in 870ms, sequenceid=17, compaction requested=true 2023-03-11 00:55:21,545 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:21,545 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:21,545 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:55:21,546 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/1d2766c176504303aa587bb83f179d04, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 00:55:21,547 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/0bc99884f1864d9bbbd65f159febcea4 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0bc99884f1864d9bbbd65f159febcea4 2023-03-11 00:55:21,551 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0bc99884f1864d9bbbd65f159febcea4, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 00:55:21,552 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 186abf08f502dabd8577259d44f7d8d9 in 880ms, sequenceid=17, compaction requested=true 2023-03-11 00:55:21,552 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:21,552 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:21,552 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:55:21,926 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/8e4fe4027e37474cb4aba5869840eba9 2023-03-11 00:55:21,931 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/2c3e11681c55425fab6a7ddf1913ff08 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/2c3e11681c55425fab6a7ddf1913ff08 2023-03-11 00:55:21,934 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/2c3e11681c55425fab6a7ddf1913ff08, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 00:55:21,935 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/8e4fe4027e37474cb4aba5869840eba9 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/8e4fe4027e37474cb4aba5869840eba9 2023-03-11 00:55:21,938 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/8e4fe4027e37474cb4aba5869840eba9, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 00:55:21,939 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 in 1263ms, sequenceid=17, compaction requested=true 2023-03-11 00:55:21,939 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:21,939 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:21,939 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:55:21,939 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:55:21,939 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,939 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-11 00:55:21,939 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-11 00:55:21,941 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:21,941 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:21,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:21,941 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:21,942 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:21,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-11 00:55:21,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41b25504[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:21,943 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-11 00:55:21,943 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:21,944 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:21,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:21,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:21,944 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-11 00:55:21,945 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-11 00:55:21,945 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:21,945 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,945 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:21,946 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,946 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-11 00:55:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:21,946 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:21,946 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-11 00:55:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:21,948 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-11 00:55:21,948 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:21,948 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:21,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-11 00:55:21,948 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-11 00:55:21,949 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:21,950 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:21,950 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:21,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:21,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:21,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:21,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:21,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:21,950 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:21,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:21,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:21,951 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:21,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:21,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:21,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:21,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:21,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,952 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:21,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:21,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:21,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:21,954 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:21,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-11 00:55:21,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:21,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:21,954 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:22,055 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:22,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:22,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 00:55:22,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678496122066 (current time:1678496122066). 2023-03-11 00:55:22,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-11 00:55:22,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] zookeeper.ReadOnlyZKClient(139): Connect 0x488c9ea6 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:55:22,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e10481c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:55:22,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:55:22,085 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34300, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:55:22,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x488c9ea6 to 127.0.0.1:62412 2023-03-11 00:55:22,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:55:22,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-11 00:55:22,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 00:55:22,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 00:55:22,096 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 00:55:22,097 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678496722097 2023-03-11 00:55:22,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 00:55:22,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1678496122056 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-11 00:55:22,098 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 00:55:22,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-11 00:55:22,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-03-11 00:55:22,100 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-11 00:55:22,100 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1678496722100 2023-03-11 00:55:22,102 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:22,102 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-11 00:55:22,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1678496122056 2023-03-11 00:55:22,114 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1678496122056' 2023-03-11 00:55:22,114 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-11 00:55:22,114 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1678496122056' starting 'acquire' 2023-03-11 00:55:22,114 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1678496122056', kicking off acquire phase on members. 2023-03-11 00:55:22,114 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678496122056 2023-03-11 00:55:22,114 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1678496122056 2023-03-11 00:55:22,115 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,115 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-11 00:55:22,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-11 00:55:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-11 00:55:22,116 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,116 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1678496122056 2023-03-11 00:55:22,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678496122056 2023-03-11 00:55:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-11 00:55:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1678496122056 2023-03-11 00:55:22,117 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1678496122056 from table testCompactionWithHFileLink type FLUSH 2023-03-11 00:55:22,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1678496122056 2023-03-11 00:55:22,119 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1678496122056' with timeout 300000ms 2023-03-11 00:55:22,119 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-11 00:55:22,119 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1678496122056' starting 'acquire' stage 2023-03-11 00:55:22,119 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1678496122056' locally acquired 2023-03-11 00:55:22,119 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (snaptb-1678496122056) in zk 2023-03-11 00:55:22,120 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1678496122056 2023-03-11 00:55:22,120 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-11 00:55:22,121 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678496122056 2023-03-11 00:55:22,121 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1678496122056' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678496122056 2023-03-11 00:55:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:22,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'snaptb-1678496122056' on coordinator 2023-03-11 00:55:22,122 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1678496122056' starting 'in-barrier' execution. 2023-03-11 00:55:22,122 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1678496122056 2023-03-11 00:55:22,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2817c312[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:22,123 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678496122056 2023-03-11 00:55:22,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1678496122056 2023-03-11 00:55:22,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1678496122056 2023-03-11 00:55:22,124 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1678496122056' received 'reached' from coordinator. 2023-03-11 00:55:22,124 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,124 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:22,124 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:22,124 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-11 00:55:22,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:22,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:22,125 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-11 00:55:22,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. started... 2023-03-11 00:55:22,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. started... 2023-03-11 00:55:22,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. started... 2023-03-11 00:55:22,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:22,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:22,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:22,126 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.' region-info for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,126 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.' region-info for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,126 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.' region-info for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,131 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-11 00:55:22,131 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-11 00:55:22,131 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-11 00:55:22,134 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/548570c7c5334fb59847e65505210396, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/aa7feaf1facf454faa04e8e49998ccf5, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/4f688fd0b53848159bbc6f2b34605b52, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/2c3e11681c55425fab6a7ddf1913ff08] hfiles 2023-03-11 00:55:22,134 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/956c50b8ec45442594956fb9ad279eb9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/29002ac597984b53a8b5902b72f6c8ab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/46813adbc92b49c58b4fc1a74dcbdd46, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/30953997ca7a4d23913d0acc8eff85fd] hfiles 2023-03-11 00:55:22,134 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/eadd8a5089914a5a961a28d9a005faab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/9c8d3bc701894145b03f6c3228555de4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/098a99876ba04417bee017780510c171, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/1d2766c176504303aa587bb83f179d04] hfiles 2023-03-11 00:55:22,134 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/956c50b8ec45442594956fb9ad279eb9 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,134 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/548570c7c5334fb59847e65505210396 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,134 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/eadd8a5089914a5a961a28d9a005faab for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,283 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 00:55:22,284 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-11 00:55:22,284 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:55:22,286 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cf8619f to 127.0.0.1:62412 2023-03-11 00:55:22,286 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:55:22,286 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:55:22,286 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69b6b6a5 to 127.0.0.1:62412 2023-03-11 00:55:22,286 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:55:22,287 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bdc8a57 to 127.0.0.1:62412 2023-03-11 00:55:22,287 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:55:22,287 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:55:22,287 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2384d5db to 127.0.0.1:62412 2023-03-11 00:55:22,287 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:55:22,288 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/29002ac597984b53a8b5902b72f6c8ab for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,288 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/aa7feaf1facf454faa04e8e49998ccf5 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,288 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/9c8d3bc701894145b03f6c3228555de4 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,288 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/4f688fd0b53848159bbc6f2b34605b52 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,288 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/2c3e11681c55425fab6a7ddf1913ff08 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,288 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/46813adbc92b49c58b4fc1a74dcbdd46 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,288 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/bdd52f8480e342c99155883d20fd5ec0, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/10f422db8f8e4ea58b30f09f7ccb669a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/3575de3147bd411b802b9b9bfdf3b93c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/8e4fe4027e37474cb4aba5869840eba9] hfiles 2023-03-11 00:55:22,288 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/098a99876ba04417bee017780510c171 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/1d2766c176504303aa587bb83f179d04 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/bdd52f8480e342c99155883d20fd5ec0 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,288 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/30953997ca7a4d23913d0acc8eff85fd for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/10f422db8f8e4ea58b30f09f7ccb669a for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/285d642b34a14520997143c089e64610, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/4be93ac838e045d9975d05c62464ace6, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/dbf45db339b14dce93ddb4c1fafb1d72, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/2af7267f1d6b4641ba22df7cb36238f9] hfiles 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/3575de3147bd411b802b9b9bfdf3b93c for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/8e4fe4027e37474cb4aba5869840eba9 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/033d4a06f89f4f64a5d06136bdd18fe4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0c0c40ea072d47408a7453d9582e974a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/fa29a3dc78264d2f9ff001bf31239001, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0bc99884f1864d9bbbd65f159febcea4] hfiles 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/285d642b34a14520997143c089e64610 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/033d4a06f89f4f64a5d06136bdd18fe4 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/4be93ac838e045d9975d05c62464ace6 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0c0c40ea072d47408a7453d9582e974a for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/dbf45db339b14dce93ddb4c1fafb1d72 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/fa29a3dc78264d2f9ff001bf31239001 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,289 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/2af7267f1d6b4641ba22df7cb36238f9 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,290 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0bc99884f1864d9bbbd65f159febcea4 for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 00:55:22,291 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-11 00:55:22,491 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 00:55:22,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 00:55:22,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 00:55:22,492 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-11 00:55:22,701 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. completed. 2023-03-11 00:55:22,701 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. completed. 2023-03-11 00:55:22,701 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:22,701 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. completed. 2023-03-11 00:55:22,701 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:22,701 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:22,702 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-11 00:55:22,702 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-11 00:55:22,702 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-11 00:55:22,702 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-11 00:55:22,702 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,702 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1678496122056' locally completed 2023-03-11 00:55:22,702 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1678496122056' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:22,703 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1678496122056' has notified controller of completion 2023-03-11 00:55:22,703 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,703 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:22,703 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1678496122056' completed. 2023-03-11 00:55:22,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-11 00:55:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678496122056 2023-03-11 00:55:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678496122056 2023-03-11 00:55:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1678496122056' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:22,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'snaptb-1678496122056', counting down latch. Waiting for 0 more 2023-03-11 00:55:22,705 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1678496122056' execution completed 2023-03-11 00:55:22,706 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:22,706 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:22,706 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1678496122056 2023-03-11 00:55:22,706 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1678496122056including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-11 00:55:22,708 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678496122056 2023-03-11 00:55:22,708 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678496122056 2023-03-11 00:55:22,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1678496122056 2023-03-11 00:55:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1678496122056 2023-03-11 00:55:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:22,708 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-11 00:55:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-11 00:55:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678496122056 2023-03-11 00:55:22,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-11 00:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:22,709 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-11 00:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678496122056 2023-03-11 00:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678496122056 2023-03-11 00:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678496122056 2023-03-11 00:55:22,710 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:22,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678496122056 2023-03-11 00:55:22,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,712 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-11 00:55:22,712 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-11 00:55:22,713 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:22,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1678496122056 because node does not exist (not an error) 2023-03-11 00:55:22,713 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1678496122056 2023-03-11 00:55:22,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-11 00:55:22,713 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678496122056 2023-03-11 00:55:22,713 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-11 00:55:22,713 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678496122056 2023-03-11 00:55:22,713 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-11 00:55:22,713 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678496122056/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:22,713 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678496122056 2023-03-11 00:55:22,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1678496122056 2023-03-11 00:55:22,713 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678496122056 2023-03-11 00:55:22,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-11 00:55:22,713 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678496122056 2023-03-11 00:55:22,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-11 00:55:22,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-11 00:55:22,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303115756febdcdbf4b999de7cd8c523988c5, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303116b231f2776864a47b304ed986ae2eb33, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031191c5858b6023453698850b6c07d3b7bb, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311e21b6d88f9724146a471b5550c202143, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311256343a0c4764e11abff441b975d0033, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112ebe3904fa1846a3ac2f07fb4dbdbfbd, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311ace8c856047e4bb3adccbb4fa0d55303, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311cb982ae2531e4cfca4d434fef9a98b95, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303110bce642178f448eab384eb7a61cb329b, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311638b71312f27478ba384c343cf242e18, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311690081347528497b9fa16b2a8dd62a2d, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311efb20048b83f4aaa9ede919244a03f0b] mob files 2023-03-11 00:55:22,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303115756febdcdbf4b999de7cd8c523988c5 2023-03-11 00:55:22,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303116b231f2776864a47b304ed986ae2eb33 2023-03-11 00:55:22,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031191c5858b6023453698850b6c07d3b7bb 2023-03-11 00:55:22,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311e21b6d88f9724146a471b5550c202143 2023-03-11 00:55:22,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311256343a0c4764e11abff441b975d0033 2023-03-11 00:55:22,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112ebe3904fa1846a3ac2f07fb4dbdbfbd 2023-03-11 00:55:22,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311ace8c856047e4bb3adccbb4fa0d55303 2023-03-11 00:55:22,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311cb982ae2531e4cfca4d434fef9a98b95 2023-03-11 00:55:22,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303110bce642178f448eab384eb7a61cb329b 2023-03-11 00:55:22,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311638b71312f27478ba384c343cf242e18 2023-03-11 00:55:22,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311690081347528497b9fa16b2a8dd62a2d 2023-03-11 00:55:22,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311efb20048b83f4aaa9ede919244a03f0b 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031170336f9451a4452583516331530ef145, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311d252dc6217a949d3bd9460994141073f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311d771b112cbe84b518ca8ff6943ce0429, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311df485881b5834a069bc87062a3775512, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031119aede9012a34c3298d6b2cd05d14e4a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031130bad12ed48f4a0b93bf813aa2fc17c6, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303116b34e4fffa8b43759aa4a2d04ce43d24, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303116dde902809b946dd9dddab7705399133, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031103814fb7c7854958824ece9b59717af7, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303116a0cada6b3b147789d1469d62b0634c2, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311af5d2ec28a8946b39d4919ce1b65fd2a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311d90c242ddc50494b9adb99bfd44e9159] mob files 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031170336f9451a4452583516331530ef145 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311d252dc6217a949d3bd9460994141073f 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311d771b112cbe84b518ca8ff6943ce0429 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311df485881b5834a069bc87062a3775512 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031119aede9012a34c3298d6b2cd05d14e4a 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031130bad12ed48f4a0b93bf813aa2fc17c6 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303116b34e4fffa8b43759aa4a2d04ce43d24 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303116dde902809b946dd9dddab7705399133 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031103814fb7c7854958824ece9b59717af7 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303116a0cada6b3b147789d1469d62b0634c2 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311af5d2ec28a8946b39d4919ce1b65fd2a 2023-03-11 00:55:22,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311d90c242ddc50494b9adb99bfd44e9159 2023-03-11 00:55:22,792 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 00:55:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 00:55:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 00:55:22,793 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-11 00:55:23,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1678496122056 2023-03-11 00:55:23,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/.tmp/snaptb-1678496122056 2023-03-11 00:55:23,293 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 00:55:23,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 00:55:23,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 00:55:23,294 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-11 00:55:23,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/.tmp/snaptb-1678496122056 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/snaptb-1678496122056 2023-03-11 00:55:23,986 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1678496122056 of table testCompactionWithHFileLink completed 2023-03-11 00:55:23,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/.tmp/snaptb-1678496122056 2023-03-11 00:55:23,986 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/.tmp/snaptb-1678496122056 2023-03-11 00:55:23,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1678496122056 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678496122097Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1678496123121 (+1024 ms)Consolidate snapshot: snaptb-1678496122056 at 1678496123121Loading Region manifests for snaptb-1678496122056 at 1678496123121Writing data manifest for snaptb-1678496122056 at 1678496123131 (+10 ms)Verifying snapshot: snaptb-1678496122056 at 1678496123538 (+407 ms)Snapshot snaptb-1678496122056 of table testCompactionWithHFileLink completed at 1678496123986 (+448 ms) 2023-03-11 00:55:23,988 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-11 00:55:23,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.8900 sec 2023-03-11 00:55:24,294 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 00:55:24,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 00:55:24,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-11 00:55:24,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:24,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:24,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-11 00:55:24,327 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-11 00:55:24,327 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:24,327 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-11 00:55:24,327 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-11 00:55:24,327 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:24,328 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:24,329 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:24,329 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:24,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:24,329 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:24,330 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:24,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:24,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:24,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:24,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:24,330 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-11 00:55:24,331 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-11 00:55:24,331 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-11 00:55:24,331 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:24,331 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-11 00:55:24,331 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:24,331 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. started... 2023-03-11 00:55:24,331 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:55:24,331 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:24,331 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:24,331 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:24,331 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. started... 2023-03-11 00:55:24,331 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 186abf08f502dabd8577259d44f7d8d9 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 00:55:24,331 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. started... 2023-03-11 00:55:24,332 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 00:55:24,332 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 053e1f32f2dd2afeb0e5696a70cb7982 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 00:55:24,351 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/135abd3ef2b94046ab553f3558ea9434 2023-03-11 00:55:24,355 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 135abd3ef2b94046ab553f3558ea9434 2023-03-11 00:55:24,766 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/26d26a90fda34fb18afe2a7964729ee8 2023-03-11 00:55:24,769 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26d26a90fda34fb18afe2a7964729ee8 2023-03-11 00:55:24,770 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/135abd3ef2b94046ab553f3558ea9434 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/135abd3ef2b94046ab553f3558ea9434 2023-03-11 00:55:24,773 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 135abd3ef2b94046ab553f3558ea9434 2023-03-11 00:55:24,773 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/135abd3ef2b94046ab553f3558ea9434, entries=3, sequenceid=24, filesize=5.0 K 2023-03-11 00:55:24,774 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/26d26a90fda34fb18afe2a7964729ee8 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/26d26a90fda34fb18afe2a7964729ee8 2023-03-11 00:55:24,778 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26d26a90fda34fb18afe2a7964729ee8 2023-03-11 00:55:24,778 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/26d26a90fda34fb18afe2a7964729ee8, entries=1, sequenceid=24, filesize=5.0 K 2023-03-11 00:55:24,779 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 186abf08f502dabd8577259d44f7d8d9 in 448ms, sequenceid=24, compaction requested=true 2023-03-11 00:55:24,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:24,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:24,779 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:55:25,151 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/e388fcaa72f545ee95185e297739e023 2023-03-11 00:55:25,154 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/6417324b1d6440f087ace1ba5a8dd42c 2023-03-11 00:55:25,156 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e388fcaa72f545ee95185e297739e023 2023-03-11 00:55:25,157 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6417324b1d6440f087ace1ba5a8dd42c 2023-03-11 00:55:25,571 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/11719533a2114f27bd8ced76754d9cd0 2023-03-11 00:55:25,574 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11719533a2114f27bd8ced76754d9cd0 2023-03-11 00:55:25,575 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/6417324b1d6440f087ace1ba5a8dd42c as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/6417324b1d6440f087ace1ba5a8dd42c 2023-03-11 00:55:25,578 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6417324b1d6440f087ace1ba5a8dd42c 2023-03-11 00:55:25,578 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/6417324b1d6440f087ace1ba5a8dd42c, entries=3, sequenceid=24, filesize=5.0 K 2023-03-11 00:55:25,579 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/11719533a2114f27bd8ced76754d9cd0 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/11719533a2114f27bd8ced76754d9cd0 2023-03-11 00:55:25,582 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11719533a2114f27bd8ced76754d9cd0 2023-03-11 00:55:25,582 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/11719533a2114f27bd8ced76754d9cd0, entries=1, sequenceid=24, filesize=5.0 K 2023-03-11 00:55:25,583 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 in 1251ms, sequenceid=24, compaction requested=true 2023-03-11 00:55:25,583 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:25,583 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:25,583 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:55:25,968 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/28531b4619e947e1a04dd6d555b24cf0 2023-03-11 00:55:25,971 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28531b4619e947e1a04dd6d555b24cf0 2023-03-11 00:55:25,972 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/e388fcaa72f545ee95185e297739e023 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/e388fcaa72f545ee95185e297739e023 2023-03-11 00:55:25,975 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e388fcaa72f545ee95185e297739e023 2023-03-11 00:55:25,975 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/e388fcaa72f545ee95185e297739e023, entries=3, sequenceid=24, filesize=5.0 K 2023-03-11 00:55:25,976 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/28531b4619e947e1a04dd6d555b24cf0 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/28531b4619e947e1a04dd6d555b24cf0 2023-03-11 00:55:25,979 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28531b4619e947e1a04dd6d555b24cf0 2023-03-11 00:55:25,979 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/28531b4619e947e1a04dd6d555b24cf0, entries=1, sequenceid=24, filesize=5.0 K 2023-03-11 00:55:25,980 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 053e1f32f2dd2afeb0e5696a70cb7982 in 1648ms, sequenceid=24, compaction requested=true 2023-03-11 00:55:25,980 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:25,980 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:25,980 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:55:25,980 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:55:25,980 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,980 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-11 00:55:25,980 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-11 00:55:25,982 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:25,982 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:25,982 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:25,982 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:25,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:25,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:25,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:25,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-11 00:55:25,983 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-11 00:55:25,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2eb13097[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:25,984 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:25,990 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:25,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:25,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:25,990 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-11 00:55:25,990 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-11 00:55:25,990 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:25,990 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,990 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:25,991 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-11 00:55:25,991 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,991 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:25,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:25,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:25,991 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-11 00:55:25,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:25,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:25,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:25,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:25,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:25,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:25,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-11 00:55:25,994 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-11 00:55:25,994 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:25,994 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:25,994 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-11 00:55:25,994 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:25,995 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:25,995 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:25,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:25,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:25,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:25,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:25,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:25,995 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:25,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:25,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:25,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:25,996 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:25,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:25,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:25,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:25,997 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:25,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:25,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 00:55:25,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:26,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:26,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:26,000 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:26,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:26,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:26,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:26,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-11 00:55:26,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:26,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:26,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-11 00:55:26,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 00:55:26,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:26,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:26,000 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:26,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:26,000 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:26,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:26,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 00:55:26,001 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 00:55:26,100 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:26,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:26,102 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:26,102 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 186abf08f502dabd8577259d44f7d8d9/family1 is initiating major compaction (all files) 2023-03-11 00:55:26,102 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:26,103 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:26,103 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 186abf08f502dabd8577259d44f7d8d9/family1 in testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:26,103 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/eadd8a5089914a5a961a28d9a005faab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/9c8d3bc701894145b03f6c3228555de4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/098a99876ba04417bee017780510c171, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/1d2766c176504303aa587bb83f179d04, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/135abd3ef2b94046ab553f3558ea9434] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp, totalSize=26.7 K 2023-03-11 00:55:26,103 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting eadd8a5089914a5a961a28d9a005faab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115260 2023-03-11 00:55:26,104 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 9c8d3bc701894145b03f6c3228555de4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:26,104 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 098a99876ba04417bee017780510c171, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:26,104 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 1d2766c176504303aa587bb83f179d04, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:26,105 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 135abd3ef2b94046ab553f3558ea9434, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 00:55:26,117 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 186abf08f502dabd8577259d44f7d8d9#family1#compaction#106 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:26,525 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230311ae7ee96dd8894e86be8668008d05d0a1_del 2023-03-11 00:55:26,525 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311ae7ee96dd8894e86be8668008d05d0a1_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311ae7ee96dd8894e86be8668008d05d0a1_del 2023-03-11 00:55:27,339 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 415358b875194af99342b70464ebeed8 2023-03-11 00:55:27,340 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/415358b875194af99342b70464ebeed8 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/415358b875194af99342b70464ebeed8 2023-03-11 00:55:27,343 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 415358b875194af99342b70464ebeed8 2023-03-11 00:55:27,344 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 186abf08f502dabd8577259d44f7d8d9/family1 of 186abf08f502dabd8577259d44f7d8d9 into 415358b875194af99342b70464ebeed8(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:27,344 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:27,344 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:27,344 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 186abf08f502dabd8577259d44f7d8d9/family2 is initiating major compaction (all files) 2023-03-11 00:55:27,344 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:27,344 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:27,345 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 186abf08f502dabd8577259d44f7d8d9/family2 in testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:27,345 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/033d4a06f89f4f64a5d06136bdd18fe4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0c0c40ea072d47408a7453d9582e974a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/fa29a3dc78264d2f9ff001bf31239001, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0bc99884f1864d9bbbd65f159febcea4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/26d26a90fda34fb18afe2a7964729ee8] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp, totalSize=25.4 K 2023-03-11 00:55:27,345 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 033d4a06f89f4f64a5d06136bdd18fe4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115260 2023-03-11 00:55:27,345 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 0c0c40ea072d47408a7453d9582e974a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:27,346 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting fa29a3dc78264d2f9ff001bf31239001, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:27,346 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 0bc99884f1864d9bbbd65f159febcea4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:27,346 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 26d26a90fda34fb18afe2a7964729ee8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 00:55:27,357 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 186abf08f502dabd8577259d44f7d8d9#family2#compaction#107 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:27,385 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/eadd8a5089914a5a961a28d9a005faab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/9c8d3bc701894145b03f6c3228555de4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/098a99876ba04417bee017780510c171, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/1d2766c176504303aa587bb83f179d04, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/135abd3ef2b94046ab553f3558ea9434] to archive 2023-03-11 00:55:27,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:27,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/eadd8a5089914a5a961a28d9a005faab to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/eadd8a5089914a5a961a28d9a005faab 2023-03-11 00:55:27,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/9c8d3bc701894145b03f6c3228555de4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/9c8d3bc701894145b03f6c3228555de4 2023-03-11 00:55:27,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/098a99876ba04417bee017780510c171 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/098a99876ba04417bee017780510c171 2023-03-11 00:55:27,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/1d2766c176504303aa587bb83f179d04 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/1d2766c176504303aa587bb83f179d04 2023-03-11 00:55:27,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/135abd3ef2b94046ab553f3558ea9434 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/135abd3ef2b94046ab553f3558ea9434 2023-03-11 00:55:27,767 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023031119e8291cdf4a490a8acdaa9e4a549edf_del 2023-03-11 00:55:27,767 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031119e8291cdf4a490a8acdaa9e4a549edf_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031119e8291cdf4a490a8acdaa9e4a549edf_del 2023-03-11 00:55:28,580 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bcf0b4c7a54b4db780ab6bf7943bb2d1 2023-03-11 00:55:28,581 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/bcf0b4c7a54b4db780ab6bf7943bb2d1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/bcf0b4c7a54b4db780ab6bf7943bb2d1 2023-03-11 00:55:28,585 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bcf0b4c7a54b4db780ab6bf7943bb2d1 2023-03-11 00:55:28,586 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 186abf08f502dabd8577259d44f7d8d9/family2 of 186abf08f502dabd8577259d44f7d8d9 into bcf0b4c7a54b4db780ab6bf7943bb2d1(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:28,586 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:28,586 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:28,586 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 053e1f32f2dd2afeb0e5696a70cb7982/family1 is initiating major compaction (all files) 2023-03-11 00:55:28,586 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:28,586 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:28,586 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 053e1f32f2dd2afeb0e5696a70cb7982/family1 in testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:28,586 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/956c50b8ec45442594956fb9ad279eb9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/29002ac597984b53a8b5902b72f6c8ab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/46813adbc92b49c58b4fc1a74dcbdd46, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/30953997ca7a4d23913d0acc8eff85fd, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/e388fcaa72f545ee95185e297739e023] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp, totalSize=26.7 K 2023-03-11 00:55:28,587 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 956c50b8ec45442594956fb9ad279eb9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115257 2023-03-11 00:55:28,587 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 29002ac597984b53a8b5902b72f6c8ab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:28,588 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 46813adbc92b49c58b4fc1a74dcbdd46, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:28,588 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 30953997ca7a4d23913d0acc8eff85fd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:28,589 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting e388fcaa72f545ee95185e297739e023, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 00:55:28,599 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 053e1f32f2dd2afeb0e5696a70cb7982#family1#compaction#108 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:28,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/033d4a06f89f4f64a5d06136bdd18fe4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0c0c40ea072d47408a7453d9582e974a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/fa29a3dc78264d2f9ff001bf31239001, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0bc99884f1864d9bbbd65f159febcea4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/26d26a90fda34fb18afe2a7964729ee8] to archive 2023-03-11 00:55:28,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:28,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/033d4a06f89f4f64a5d06136bdd18fe4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/033d4a06f89f4f64a5d06136bdd18fe4 2023-03-11 00:55:28,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0c0c40ea072d47408a7453d9582e974a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0c0c40ea072d47408a7453d9582e974a 2023-03-11 00:55:28,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/fa29a3dc78264d2f9ff001bf31239001 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/fa29a3dc78264d2f9ff001bf31239001 2023-03-11 00:55:28,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0bc99884f1864d9bbbd65f159febcea4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/0bc99884f1864d9bbbd65f159febcea4 2023-03-11 00:55:28,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/26d26a90fda34fb18afe2a7964729ee8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/26d26a90fda34fb18afe2a7964729ee8 2023-03-11 00:55:29,006 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023031176a3a6eed6214969a5d79406051667f6_del 2023-03-11 00:55:29,007 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031176a3a6eed6214969a5d79406051667f6_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031176a3a6eed6214969a5d79406051667f6_del 2023-03-11 00:55:29,820 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75225f5e19174ac399e712d46d5cbde2 2023-03-11 00:55:29,821 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/75225f5e19174ac399e712d46d5cbde2 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/75225f5e19174ac399e712d46d5cbde2 2023-03-11 00:55:29,824 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75225f5e19174ac399e712d46d5cbde2 2023-03-11 00:55:29,825 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 053e1f32f2dd2afeb0e5696a70cb7982/family1 of 053e1f32f2dd2afeb0e5696a70cb7982 into 75225f5e19174ac399e712d46d5cbde2(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:29,825 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:29,825 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:29,826 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 053e1f32f2dd2afeb0e5696a70cb7982/family2 is initiating major compaction (all files) 2023-03-11 00:55:29,826 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:29,826 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:29,826 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 053e1f32f2dd2afeb0e5696a70cb7982/family2 in testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:29,826 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/285d642b34a14520997143c089e64610, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/4be93ac838e045d9975d05c62464ace6, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/dbf45db339b14dce93ddb4c1fafb1d72, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/2af7267f1d6b4641ba22df7cb36238f9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/28531b4619e947e1a04dd6d555b24cf0] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp, totalSize=25.4 K 2023-03-11 00:55:29,826 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 285d642b34a14520997143c089e64610, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115257 2023-03-11 00:55:29,827 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 4be93ac838e045d9975d05c62464ace6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:29,827 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting dbf45db339b14dce93ddb4c1fafb1d72, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:29,827 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 2af7267f1d6b4641ba22df7cb36238f9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:29,828 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 28531b4619e947e1a04dd6d555b24cf0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 00:55:29,839 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 053e1f32f2dd2afeb0e5696a70cb7982#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:29,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/956c50b8ec45442594956fb9ad279eb9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/29002ac597984b53a8b5902b72f6c8ab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/46813adbc92b49c58b4fc1a74dcbdd46, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/30953997ca7a4d23913d0acc8eff85fd, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/e388fcaa72f545ee95185e297739e023] to archive 2023-03-11 00:55:29,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:29,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/956c50b8ec45442594956fb9ad279eb9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/956c50b8ec45442594956fb9ad279eb9 2023-03-11 00:55:29,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/29002ac597984b53a8b5902b72f6c8ab to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/29002ac597984b53a8b5902b72f6c8ab 2023-03-11 00:55:29,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/46813adbc92b49c58b4fc1a74dcbdd46 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/46813adbc92b49c58b4fc1a74dcbdd46 2023-03-11 00:55:29,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/30953997ca7a4d23913d0acc8eff85fd to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/30953997ca7a4d23913d0acc8eff85fd 2023-03-11 00:55:29,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/e388fcaa72f545ee95185e297739e023 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/e388fcaa72f545ee95185e297739e023 2023-03-11 00:55:30,250 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230311e2e03471e04949e4829c5a4701596da7_del 2023-03-11 00:55:30,250 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311e2e03471e04949e4829c5a4701596da7_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311e2e03471e04949e4829c5a4701596da7_del 2023-03-11 00:55:31,064 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c825b02fcdea487f80d14653a587fe9c 2023-03-11 00:55:31,065 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/c825b02fcdea487f80d14653a587fe9c as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/c825b02fcdea487f80d14653a587fe9c 2023-03-11 00:55:31,069 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c825b02fcdea487f80d14653a587fe9c 2023-03-11 00:55:31,069 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 053e1f32f2dd2afeb0e5696a70cb7982/family2 of 053e1f32f2dd2afeb0e5696a70cb7982 into c825b02fcdea487f80d14653a587fe9c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:31,070 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:31,070 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:31,070 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 is initiating major compaction (all files) 2023-03-11 00:55:31,070 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:31,070 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:31,070 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 in testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:31,070 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/548570c7c5334fb59847e65505210396, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/aa7feaf1facf454faa04e8e49998ccf5, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/4f688fd0b53848159bbc6f2b34605b52, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/2c3e11681c55425fab6a7ddf1913ff08, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/6417324b1d6440f087ace1ba5a8dd42c] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp, totalSize=26.7 K 2023-03-11 00:55:31,070 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 548570c7c5334fb59847e65505210396, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115259 2023-03-11 00:55:31,071 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting aa7feaf1facf454faa04e8e49998ccf5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:31,071 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 4f688fd0b53848159bbc6f2b34605b52, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:31,071 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 2c3e11681c55425fab6a7ddf1913ff08, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:31,072 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 6417324b1d6440f087ace1ba5a8dd42c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 00:55:31,083 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 6f70d0cb8cdfe50a22b0232bd3d5c5b9#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:31,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/285d642b34a14520997143c089e64610, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/4be93ac838e045d9975d05c62464ace6, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/dbf45db339b14dce93ddb4c1fafb1d72, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/2af7267f1d6b4641ba22df7cb36238f9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/28531b4619e947e1a04dd6d555b24cf0] to archive 2023-03-11 00:55:31,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:31,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/285d642b34a14520997143c089e64610 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/285d642b34a14520997143c089e64610 2023-03-11 00:55:31,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/4be93ac838e045d9975d05c62464ace6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/4be93ac838e045d9975d05c62464ace6 2023-03-11 00:55:31,091 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230311f3a7df7bdfa94678903401043dfbfed6_del 2023-03-11 00:55:31,091 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311f3a7df7bdfa94678903401043dfbfed6_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311f3a7df7bdfa94678903401043dfbfed6_del 2023-03-11 00:55:31,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/dbf45db339b14dce93ddb4c1fafb1d72 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/dbf45db339b14dce93ddb4c1fafb1d72 2023-03-11 00:55:31,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/2af7267f1d6b4641ba22df7cb36238f9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/2af7267f1d6b4641ba22df7cb36238f9 2023-03-11 00:55:31,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/28531b4619e947e1a04dd6d555b24cf0 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/28531b4619e947e1a04dd6d555b24cf0 2023-03-11 00:55:31,905 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79a398351ad7471a87eff92de4662264 2023-03-11 00:55:31,906 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/79a398351ad7471a87eff92de4662264 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/79a398351ad7471a87eff92de4662264 2023-03-11 00:55:31,909 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79a398351ad7471a87eff92de4662264 2023-03-11 00:55:31,910 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 of 6f70d0cb8cdfe50a22b0232bd3d5c5b9 into 79a398351ad7471a87eff92de4662264(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:55:31,910 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:31,910 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:31,910 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2 is initiating major compaction (all files) 2023-03-11 00:55:31,910 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:31,910 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:31,911 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2 in testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:31,911 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/bdd52f8480e342c99155883d20fd5ec0, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/10f422db8f8e4ea58b30f09f7ccb669a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/3575de3147bd411b802b9b9bfdf3b93c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/8e4fe4027e37474cb4aba5869840eba9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/11719533a2114f27bd8ced76754d9cd0] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp, totalSize=25.4 K 2023-03-11 00:55:31,911 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting bdd52f8480e342c99155883d20fd5ec0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115259 2023-03-11 00:55:31,911 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 10f422db8f8e4ea58b30f09f7ccb669a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:31,912 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 3575de3147bd411b802b9b9bfdf3b93c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:31,912 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 8e4fe4027e37474cb4aba5869840eba9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:31,912 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 11719533a2114f27bd8ced76754d9cd0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 00:55:31,921 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 6f70d0cb8cdfe50a22b0232bd3d5c5b9#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:31,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/548570c7c5334fb59847e65505210396, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/aa7feaf1facf454faa04e8e49998ccf5, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/4f688fd0b53848159bbc6f2b34605b52, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/2c3e11681c55425fab6a7ddf1913ff08, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/6417324b1d6440f087ace1ba5a8dd42c] to archive 2023-03-11 00:55:31,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:31,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/548570c7c5334fb59847e65505210396 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/548570c7c5334fb59847e65505210396 2023-03-11 00:55:31,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/aa7feaf1facf454faa04e8e49998ccf5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/aa7feaf1facf454faa04e8e49998ccf5 2023-03-11 00:55:31,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/4f688fd0b53848159bbc6f2b34605b52 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/4f688fd0b53848159bbc6f2b34605b52 2023-03-11 00:55:31,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/2c3e11681c55425fab6a7ddf1913ff08 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/2c3e11681c55425fab6a7ddf1913ff08 2023-03-11 00:55:31,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/6417324b1d6440f087ace1ba5a8dd42c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/6417324b1d6440f087ace1ba5a8dd42c 2023-03-11 00:55:32,332 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023031184bcc6ed41224564b8cb1dd69ecc7184_del 2023-03-11 00:55:32,332 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031184bcc6ed41224564b8cb1dd69ecc7184_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031184bcc6ed41224564b8cb1dd69ecc7184_del 2023-03-11 00:55:33,146 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f040cfcde48c4a388e2b9028c2f3cb3d 2023-03-11 00:55:33,147 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/f040cfcde48c4a388e2b9028c2f3cb3d as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/f040cfcde48c4a388e2b9028c2f3cb3d 2023-03-11 00:55:33,151 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f040cfcde48c4a388e2b9028c2f3cb3d 2023-03-11 00:55:33,152 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2 of 6f70d0cb8cdfe50a22b0232bd3d5c5b9 into f040cfcde48c4a388e2b9028c2f3cb3d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:33,152 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:33,157 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:33,161 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:33,166 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:33,167 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:33,174 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 00:55:33,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/bdd52f8480e342c99155883d20fd5ec0, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/10f422db8f8e4ea58b30f09f7ccb669a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/3575de3147bd411b802b9b9bfdf3b93c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/8e4fe4027e37474cb4aba5869840eba9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/11719533a2114f27bd8ced76754d9cd0] to archive 2023-03-11 00:55:33,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:33,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/bdd52f8480e342c99155883d20fd5ec0 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/bdd52f8480e342c99155883d20fd5ec0 2023-03-11 00:55:33,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/10f422db8f8e4ea58b30f09f7ccb669a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/10f422db8f8e4ea58b30f09f7ccb669a 2023-03-11 00:55:33,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/3575de3147bd411b802b9b9bfdf3b93c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/3575de3147bd411b802b9b9bfdf3b93c 2023-03-11 00:55:33,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/8e4fe4027e37474cb4aba5869840eba9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/8e4fe4027e37474cb4aba5869840eba9 2023-03-11 00:55:33,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/11719533a2114f27bd8ced76754d9cd0 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/11719533a2114f27bd8ced76754d9cd0 2023-03-11 00:55:33,208 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-11 00:55:33,212 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023031176a3a6eed6214969a5d79406051667f6_del 2023-03-11 00:55:33,215 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230311f3a7df7bdfa94678903401043dfbfed6_del 2023-03-11 00:55:33,218 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230311ae7ee96dd8894e86be8668008d05d0a1_del 2023-03-11 00:55:33,218 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:33,219 DEBUG [Listener at localhost/45619] zookeeper.ReadOnlyZKClient(139): Connect 0x3ed89200 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:55:33,224 DEBUG [Listener at localhost/45619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e0a523f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:55:33,224 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:33,225 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:33,225 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:33,306 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311ef0eca6446b94a1baaa03845a9736963 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311ef0eca6446b94a1baaa03845a9736963 2023-03-11 00:55:33,308 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:33,316 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303111120e8c3a95842f7b69b66b2c0a519bf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303111120e8c3a95842f7b69b66b2c0a519bf 2023-03-11 00:55:33,316 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:33,327 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:55:33,330 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41706, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:55:33,336 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:55:33,341 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35604, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:55:33,351 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/b4701b21ab7247fa93c19525351cb0a4 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-11 00:55:33,351 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/b4701b21ab7247fa93c19525351cb0a4}] 2023-03-11 00:55:33,353 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/d2fb3e154a474be2b02de8290c1bed9f first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-11 00:55:33,355 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/d2fb3e154a474be2b02de8290c1bed9f}] 2023-03-11 00:55:33,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/b4701b21ab7247fa93c19525351cb0a4 for inclusion in 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 2023-03-11 00:55:33,358 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/d2fb3e154a474be2b02de8290c1bed9f for inclusion in 186abf08f502dabd8577259d44f7d8d9/family1 2023-03-11 00:55:33,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-11 00:55:33,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-11 00:55:33,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-11 00:55:33,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-11 00:55:33,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:33,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:33,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/b4701b21ab7247fa93c19525351cb0a4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__59qgashi3c283mhs7akg0hnjug42hc15ggiptg0h3b1lkp7rl6q7d7v4o0q99ol9/family1/b4701b21ab7247fa93c19525351cb0a4 2023-03-11 00:55:33,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/d2fb3e154a474be2b02de8290c1bed9f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__n4sr9tjfp0kg192hhn4ugvg5comeqrmolg349og56uilpdcbt3h4csqlas1ovcu0/family1/d2fb3e154a474be2b02de8290c1bed9f 2023-03-11 00:55:33,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__59qgashi3c283mhs7akg0hnjug42hc15ggiptg0h3b1lkp7rl6q7d7v4o0q99ol9/family1/b4701b21ab7247fa93c19525351cb0a4 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/e3400e6347ef47d48ad7c60255a59e0f_SeqId_29_ 2023-03-11 00:55:33,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__n4sr9tjfp0kg192hhn4ugvg5comeqrmolg349og56uilpdcbt3h4csqlas1ovcu0/family1/d2fb3e154a474be2b02de8290c1bed9f as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/3f5fca46b59a403d8d2a912a8513c15f_SeqId_29_ 2023-03-11 00:55:33,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__59qgashi3c283mhs7akg0hnjug42hc15ggiptg0h3b1lkp7rl6q7d7v4o0q99ol9/family1/b4701b21ab7247fa93c19525351cb0a4 into 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/e3400e6347ef47d48ad7c60255a59e0f_SeqId_29_ - updating store file list. 2023-03-11 00:55:33,364 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__n4sr9tjfp0kg192hhn4ugvg5comeqrmolg349og56uilpdcbt3h4csqlas1ovcu0/family1/d2fb3e154a474be2b02de8290c1bed9f into 186abf08f502dabd8577259d44f7d8d9/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/3f5fca46b59a403d8d2a912a8513c15f_SeqId_29_ - updating store file list. 2023-03-11 00:55:33,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/e3400e6347ef47d48ad7c60255a59e0f_SeqId_29_ into 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 2023-03-11 00:55:33,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__59qgashi3c283mhs7akg0hnjug42hc15ggiptg0h3b1lkp7rl6q7d7v4o0q99ol9/family1/b4701b21ab7247fa93c19525351cb0a4 into 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/e3400e6347ef47d48ad7c60255a59e0f_SeqId_29_) 2023-03-11 00:55:33,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/3f5fca46b59a403d8d2a912a8513c15f_SeqId_29_ into 186abf08f502dabd8577259d44f7d8d9/family1 2023-03-11 00:55:33,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__n4sr9tjfp0kg192hhn4ugvg5comeqrmolg349og56uilpdcbt3h4csqlas1ovcu0/family1/d2fb3e154a474be2b02de8290c1bed9f into 186abf08f502dabd8577259d44f7d8d9/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/3f5fca46b59a403d8d2a912a8513c15f_SeqId_29_) 2023-03-11 00:55:33,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__59qgashi3c283mhs7akg0hnjug42hc15ggiptg0h3b1lkp7rl6q7d7v4o0q99ol9/family1/b4701b21ab7247fa93c19525351cb0a4 2023-03-11 00:55:33,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__n4sr9tjfp0kg192hhn4ugvg5comeqrmolg349og56uilpdcbt3h4csqlas1ovcu0/family1/d2fb3e154a474be2b02de8290c1bed9f 2023-03-11 00:55:33,370 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:33,370 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:33,370 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:33,370 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:33,372 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303115756febdcdbf4b999de7cd8c523988c5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303115756febdcdbf4b999de7cd8c523988c5 2023-03-11 00:55:33,372 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311256343a0c4764e11abff441b975d0033 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311256343a0c4764e11abff441b975d0033 2023-03-11 00:55:33,373 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303116b231f2776864a47b304ed986ae2eb33 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303116b231f2776864a47b304ed986ae2eb33 2023-03-11 00:55:33,373 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112ebe3904fa1846a3ac2f07fb4dbdbfbd to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112ebe3904fa1846a3ac2f07fb4dbdbfbd 2023-03-11 00:55:33,374 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031191c5858b6023453698850b6c07d3b7bb to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031191c5858b6023453698850b6c07d3b7bb 2023-03-11 00:55:33,374 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311ace8c856047e4bb3adccbb4fa0d55303 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311ace8c856047e4bb3adccbb4fa0d55303 2023-03-11 00:55:33,375 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311e21b6d88f9724146a471b5550c202143 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311e21b6d88f9724146a471b5550c202143 2023-03-11 00:55:33,375 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 00:55:33,375 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311cb982ae2531e4cfca4d434fef9a98b95 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311cb982ae2531e4cfca4d434fef9a98b95 2023-03-11 00:55:33,375 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311' 2023-03-11 00:55:33,375 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 00:55:33,375 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311' 2023-03-11 00:55:33,376 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:33,376 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:34,101 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031186ae9a2e97aa4825964c8d112cf5a611 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031186ae9a2e97aa4825964c8d112cf5a611 2023-03-11 00:55:34,102 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:34,126 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/37592868ee694d8b8d75bfe958477df6 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-11 00:55:34,126 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/37592868ee694d8b8d75bfe958477df6}] 2023-03-11 00:55:34,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/37592868ee694d8b8d75bfe958477df6 for inclusion in 053e1f32f2dd2afeb0e5696a70cb7982/family1 2023-03-11 00:55:34,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-11 00:55:34,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last=1 2023-03-11 00:55:34,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:34,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/37592868ee694d8b8d75bfe958477df6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__jpaf1copq08nr6idm089g4nvqhub6mn2ssnoi2bbmtd1i6pp5fg9b8bccpmm25kv/family1/37592868ee694d8b8d75bfe958477df6 2023-03-11 00:55:34,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__jpaf1copq08nr6idm089g4nvqhub6mn2ssnoi2bbmtd1i6pp5fg9b8bccpmm25kv/family1/37592868ee694d8b8d75bfe958477df6 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/5f9ad8ee374b47718dc4e632d351b597_SeqId_29_ 2023-03-11 00:55:34,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__jpaf1copq08nr6idm089g4nvqhub6mn2ssnoi2bbmtd1i6pp5fg9b8bccpmm25kv/family1/37592868ee694d8b8d75bfe958477df6 into 053e1f32f2dd2afeb0e5696a70cb7982/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/5f9ad8ee374b47718dc4e632d351b597_SeqId_29_ - updating store file list. 2023-03-11 00:55:34,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/5f9ad8ee374b47718dc4e632d351b597_SeqId_29_ into 053e1f32f2dd2afeb0e5696a70cb7982/family1 2023-03-11 00:55:34,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__jpaf1copq08nr6idm089g4nvqhub6mn2ssnoi2bbmtd1i6pp5fg9b8bccpmm25kv/family1/37592868ee694d8b8d75bfe958477df6 into 053e1f32f2dd2afeb0e5696a70cb7982/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/5f9ad8ee374b47718dc4e632d351b597_SeqId_29_) 2023-03-11 00:55:34,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__jpaf1copq08nr6idm089g4nvqhub6mn2ssnoi2bbmtd1i6pp5fg9b8bccpmm25kv/family1/37592868ee694d8b8d75bfe958477df6 2023-03-11 00:55:34,139 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:34,140 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:34,141 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303110bce642178f448eab384eb7a61cb329b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303110bce642178f448eab384eb7a61cb329b 2023-03-11 00:55:34,142 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311638b71312f27478ba384c343cf242e18 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311638b71312f27478ba384c343cf242e18 2023-03-11 00:55:34,142 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311690081347528497b9fa16b2a8dd62a2d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311690081347528497b9fa16b2a8dd62a2d 2023-03-11 00:55:34,143 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311efb20048b83f4aaa9ede919244a03f0b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311efb20048b83f4aaa9ede919244a03f0b 2023-03-11 00:55:34,143 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 00:55:34,143 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311' 2023-03-11 00:55:34,144 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:34,144 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:34,144 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:34,144 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031176a3a6eed6214969a5d79406051667f6_del] 2023-03-11 00:55:34,144 DEBUG [Listener at localhost/45619] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:34,145 DEBUG [Listener at localhost/45619] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031176a3a6eed6214969a5d79406051667f6_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031176a3a6eed6214969a5d79406051667f6_del 2023-03-11 00:55:34,146 INFO [Listener at localhost/45619] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-11 00:55:34,146 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311f3a7df7bdfa94678903401043dfbfed6_del] 2023-03-11 00:55:34,146 DEBUG [Listener at localhost/45619] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:34,147 DEBUG [Listener at localhost/45619] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311f3a7df7bdfa94678903401043dfbfed6_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311f3a7df7bdfa94678903401043dfbfed6_del 2023-03-11 00:55:34,147 INFO [Listener at localhost/45619] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-11 00:55:34,147 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311ae7ee96dd8894e86be8668008d05d0a1_del] 2023-03-11 00:55:34,147 DEBUG [Listener at localhost/45619] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:34,148 DEBUG [Listener at localhost/45619] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311ae7ee96dd8894e86be8668008d05d0a1_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311ae7ee96dd8894e86be8668008d05d0a1_del 2023-03-11 00:55:34,149 INFO [Listener at localhost/45619] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-11 00:55:34,151 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:34,153 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:34,156 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:34,157 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:34,165 INFO [Listener at localhost/45619] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-11 00:55:34,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-03-11 00:55:34,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-11 00:55:34,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-11 00:55:34,168 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496134168"}]},"ts":"1678496134168"} 2023-03-11 00:55:34,170 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-11 00:55:34,171 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-11 00:55:34,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, UNASSIGN}] 2023-03-11 00:55:34,173 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, UNASSIGN 2023-03-11 00:55:34,174 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, UNASSIGN 2023-03-11 00:55:34,174 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, UNASSIGN 2023-03-11 00:55:34,174 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=6f70d0cb8cdfe50a22b0232bd3d5c5b9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:34,174 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496134174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496134174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496134174"}]},"ts":"1678496134174"} 2023-03-11 00:55:34,174 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=053e1f32f2dd2afeb0e5696a70cb7982, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:34,174 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496134174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496134174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496134174"}]},"ts":"1678496134174"} 2023-03-11 00:55:34,175 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=186abf08f502dabd8577259d44f7d8d9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:34,175 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496134175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496134175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496134175"}]},"ts":"1678496134175"} 2023-03-11 00:55:34,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 6f70d0cb8cdfe50a22b0232bd3d5c5b9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:34,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 053e1f32f2dd2afeb0e5696a70cb7982, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:34,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 186abf08f502dabd8577259d44f7d8d9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:34,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-11 00:55:34,296 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(317): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,38819,1678496016129, timeout=1678496134327, delay=31, operations=[pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 186abf08f502dabd8577259d44f7d8d9, server=jenkins-hbase4.apache.org,38819,1678496016129, pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 053e1f32f2dd2afeb0e5696a70cb7982, server=jenkins-hbase4.apache.org,38819,1678496016129, pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 6f70d0cb8cdfe50a22b0232bd3d5c5b9, server=jenkins-hbase4.apache.org,38819,1678496016129]] 2023-03-11 00:55:34,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:34,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 186abf08f502dabd8577259d44f7d8d9, disabling compactions & flushes 2023-03-11 00:55:34,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:34,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:34,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. after waiting 0 ms 2023-03-11 00:55:34,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:34,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-11 00:55:34,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:34,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:34,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:34,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:34,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 053e1f32f2dd2afeb0e5696a70cb7982, disabling compactions & flushes 2023-03-11 00:55:34,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:34,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:34,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. after waiting 0 ms 2023-03-11 00:55:34,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:34,334 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=186abf08f502dabd8577259d44f7d8d9, regionState=CLOSED 2023-03-11 00:55:34,335 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496134334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496134334"}]},"ts":"1678496134334"} 2023-03-11 00:55:34,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-03-11 00:55:34,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 186abf08f502dabd8577259d44f7d8d9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 160 msec 2023-03-11 00:55:34,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-11 00:55:34,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, UNASSIGN in 165 msec 2023-03-11 00:55:34,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:34,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:34,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:34,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:34,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f70d0cb8cdfe50a22b0232bd3d5c5b9, disabling compactions & flushes 2023-03-11 00:55:34,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:34,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:34,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. after waiting 0 ms 2023-03-11 00:55:34,341 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=053e1f32f2dd2afeb0e5696a70cb7982, regionState=CLOSED 2023-03-11 00:55:34,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:34,341 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496134341"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496134341"}]},"ts":"1678496134341"} 2023-03-11 00:55:34,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-03-11 00:55:34,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 053e1f32f2dd2afeb0e5696a70cb7982, server=jenkins-hbase4.apache.org,38819,1678496016129 in 167 msec 2023-03-11 00:55:34,346 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, UNASSIGN in 173 msec 2023-03-11 00:55:34,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-11 00:55:34,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:34,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:34,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:34,349 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=6f70d0cb8cdfe50a22b0232bd3d5c5b9, regionState=CLOSED 2023-03-11 00:55:34,349 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496134349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496134349"}]},"ts":"1678496134349"} 2023-03-11 00:55:34,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-03-11 00:55:34,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 6f70d0cb8cdfe50a22b0232bd3d5c5b9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 175 msec 2023-03-11 00:55:34,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-03-11 00:55:34,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, UNASSIGN in 180 msec 2023-03-11 00:55:34,353 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496134353"}]},"ts":"1678496134353"} 2023-03-11 00:55:34,354 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-11 00:55:34,356 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-11 00:55:34,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 191 msec 2023-03-11 00:55:34,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-11 00:55:34,471 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-11 00:55:34,482 INFO [Listener at localhost/45619] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1678496122056-1678496134482 2023-03-11 00:55:34,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 00:55:34,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678496134483 (current time:1678496134483). 2023-03-11 00:55:34,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-11 00:55:34,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] zookeeper.ReadOnlyZKClient(139): Connect 0x77a9a79b to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:55:34,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40ce0cab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:55:34,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:55:34,492 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32830, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:55:34,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77a9a79b to 127.0.0.1:62412 2023-03-11 00:55:34,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:55:34,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-11 00:55:34,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 00:55:34,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 00:55:34,496 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 00:55:34,496 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678496734496 2023-03-11 00:55:34,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 00:55:34,496 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1678496122056-1678496134482 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-11 00:55:34,497 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:34,497 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-11 00:55:34,597 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 00:55:34,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 00:55:34,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 00:55:34,599 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-11 00:55:34,799 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 00:55:34,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 00:55:34,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 00:55:34,800 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-11 00:55:34,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-11 00:55:34,905 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-11 00:55:34,905 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-11 00:55:34,905 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-11 00:55:34,905 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-11 00:55:34,905 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-11 00:55:34,905 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-11 00:55:34,905 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-11 00:55:34,905 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-11 00:55:34,908 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/5f9ad8ee374b47718dc4e632d351b597_SeqId_29_, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/75225f5e19174ac399e712d46d5cbde2] hfiles 2023-03-11 00:55:34,908 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/5f9ad8ee374b47718dc4e632d351b597_SeqId_29_ 2023-03-11 00:55:34,908 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/3f5fca46b59a403d8d2a912a8513c15f_SeqId_29_, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/415358b875194af99342b70464ebeed8] hfiles 2023-03-11 00:55:34,908 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/75225f5e19174ac399e712d46d5cbde2 2023-03-11 00:55:34,908 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/3f5fca46b59a403d8d2a912a8513c15f_SeqId_29_ 2023-03-11 00:55:34,908 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/415358b875194af99342b70464ebeed8 2023-03-11 00:55:34,908 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/79a398351ad7471a87eff92de4662264, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/e3400e6347ef47d48ad7c60255a59e0f_SeqId_29_] hfiles 2023-03-11 00:55:34,908 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/79a398351ad7471a87eff92de4662264 2023-03-11 00:55:34,908 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311ef0eca6446b94a1baaa03845a9736963, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303111120e8c3a95842f7b69b66b2c0a519bf, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031186ae9a2e97aa4825964c8d112cf5a611] hfiles 2023-03-11 00:55:34,908 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/e3400e6347ef47d48ad7c60255a59e0f_SeqId_29_ 2023-03-11 00:55:34,909 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311ef0eca6446b94a1baaa03845a9736963 2023-03-11 00:55:34,909 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303111120e8c3a95842f7b69b66b2c0a519bf 2023-03-11 00:55:34,909 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031186ae9a2e97aa4825964c8d112cf5a611 2023-03-11 00:55:34,909 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/c825b02fcdea487f80d14653a587fe9c] hfiles 2023-03-11 00:55:34,909 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/bcf0b4c7a54b4db780ab6bf7943bb2d1] hfiles 2023-03-11 00:55:34,909 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/c825b02fcdea487f80d14653a587fe9c 2023-03-11 00:55:34,909 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/bcf0b4c7a54b4db780ab6bf7943bb2d1 2023-03-11 00:55:34,909 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/f040cfcde48c4a388e2b9028c2f3cb3d] hfiles 2023-03-11 00:55:34,909 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/f040cfcde48c4a388e2b9028c2f3cb3d 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031170336f9451a4452583516331530ef145, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031184bcc6ed41224564b8cb1dd69ecc7184_del, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311d252dc6217a949d3bd9460994141073f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311d771b112cbe84b518ca8ff6943ce0429, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311df485881b5834a069bc87062a3775512, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031119aede9012a34c3298d6b2cd05d14e4a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031119e8291cdf4a490a8acdaa9e4a549edf_del, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031130bad12ed48f4a0b93bf813aa2fc17c6, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303116b34e4fffa8b43759aa4a2d04ce43d24, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303116dde902809b946dd9dddab7705399133, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031103814fb7c7854958824ece9b59717af7, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303116a0cada6b3b147789d1469d62b0634c2, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311af5d2ec28a8946b39d4919ce1b65fd2a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311d90c242ddc50494b9adb99bfd44e9159, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311e2e03471e04949e4829c5a4701596da7_del] hfiles 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031170336f9451a4452583516331530ef145 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031184bcc6ed41224564b8cb1dd69ecc7184_del 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311d252dc6217a949d3bd9460994141073f 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311d771b112cbe84b518ca8ff6943ce0429 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311df485881b5834a069bc87062a3775512 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031119aede9012a34c3298d6b2cd05d14e4a 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031119e8291cdf4a490a8acdaa9e4a549edf_del 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031130bad12ed48f4a0b93bf813aa2fc17c6 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303116b34e4fffa8b43759aa4a2d04ce43d24 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303116dde902809b946dd9dddab7705399133 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031103814fb7c7854958824ece9b59717af7 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303116a0cada6b3b147789d1469d62b0634c2 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311af5d2ec28a8946b39d4919ce1b65fd2a 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311d90c242ddc50494b9adb99bfd44e9159 2023-03-11 00:55:34,915 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311e2e03471e04949e4829c5a4701596da7_del 2023-03-11 00:55:35,100 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 00:55:35,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 00:55:35,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 00:55:35,101 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-11 00:55:35,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-11 00:55:35,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1678496122056-1678496134482 2023-03-11 00:55:35,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678496122056-1678496134482 2023-03-11 00:55:35,601 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 00:55:35,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 00:55:35,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 00:55:35,602 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-11 00:55:35,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678496122056-1678496134482 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/hbase-failsafe-snaptb-1678496122056-1678496134482 2023-03-11 00:55:36,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1678496122056-1678496134482 of table testCompactionWithHFileLink completed 2023-03-11 00:55:36,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678496122056-1678496134482 2023-03-11 00:55:36,570 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678496122056-1678496134482 2023-03-11 00:55:36,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1678496122056-1678496134482 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678496134497Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1678496134903 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1678496122056-1678496134482 at 1678496135323 (+420 ms)Loading Region manifests for hbase-failsafe-snaptb-1678496122056-1678496134482 at 1678496135323Writing data manifest for hbase-failsafe-snaptb-1678496122056-1678496134482 at 1678496135326 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1678496122056-1678496134482 at 1678496135732 (+406 ms)Snapshot hbase-failsafe-snaptb-1678496122056-1678496134482 of table testCompactionWithHFileLink completed at 1678496136569 (+837 ms) 2023-03-11 00:55:36,571 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 00:55:36,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0760 sec 2023-03-11 00:55:36,602 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 00:55:36,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 00:55:36,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1678496122056-1678496134482 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-11 00:55:36,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678496122056" table: "testCompactionWithHFileLink" creation_time: 1678496122066 type: FLUSH version: 2 ttl: 0 ) 2023-03-11 00:55:36,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1678496122056 as table=testCompactionWithHFileLink 2023-03-11 00:55:36,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-11 00:55:36,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-11 00:55:36,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-11 00:55:37,051 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-11 00:55:37,052 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-11 00:55:37,052 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-11 00:55:37,053 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 00:55:37,057 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1678496122056" table: "testCompactionWithHFileLink" creation_time: 1678496122066 type: FLUSH version: 2 ttl: 0 2023-03-11 00:55:37,058 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink 2023-03-11 00:55:37,062 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-11 00:55:37,065 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311ef0eca6446b94a1baaa03845a9736963 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311ef0eca6446b94a1baaa03845a9736963 2023-03-11 00:55:37,067 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031186ae9a2e97aa4825964c8d112cf5a611 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031186ae9a2e97aa4825964c8d112cf5a611 2023-03-11 00:55:37,068 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303111120e8c3a95842f7b69b66b2c0a519bf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303111120e8c3a95842f7b69b66b2c0a519bf 2023-03-11 00:55:37,068 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303115756febdcdbf4b999de7cd8c523988c5 of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,071 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303116b231f2776864a47b304ed986ae2eb33 of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,074 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023031191c5858b6023453698850b6c07d3b7bb of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,076 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230311e21b6d88f9724146a471b5550c202143 of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,079 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230311256343a0c4764e11abff441b975d0033 of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,082 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303112ebe3904fa1846a3ac2f07fb4dbdbfbd of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,085 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230311ace8c856047e4bb3adccbb4fa0d55303 of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,087 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230311cb982ae2531e4cfca4d434fef9a98b95 of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,090 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303110bce642178f448eab384eb7a61cb329b of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,093 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230311638b71312f27478ba384c343cf242e18 of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,095 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230311690081347528497b9fa16b2a8dd62a2d of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,098 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230311efb20048b83f4aaa9ede919244a03f0b of snapshot=snaptb-1678496122056 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 00:55:37,102 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311e2e03471e04949e4829c5a4701596da7_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311e2e03471e04949e4829c5a4701596da7_del 2023-03-11 00:55:37,103 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031119e8291cdf4a490a8acdaa9e4a549edf_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031119e8291cdf4a490a8acdaa9e4a549edf_del 2023-03-11 00:55:37,104 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031184bcc6ed41224564b8cb1dd69ecc7184_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031184bcc6ed41224564b8cb1dd69ecc7184_del 2023-03-11 00:55:37,104 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:37,104 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:37,104 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:37,110 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/5f9ad8ee374b47718dc4e632d351b597_SeqId_29_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/5f9ad8ee374b47718dc4e632d351b597_SeqId_29_ 2023-03-11 00:55:37,110 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/415358b875194af99342b70464ebeed8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/415358b875194af99342b70464ebeed8 2023-03-11 00:55:37,111 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/79a398351ad7471a87eff92de4662264 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/79a398351ad7471a87eff92de4662264 2023-03-11 00:55:37,112 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/75225f5e19174ac399e712d46d5cbde2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/75225f5e19174ac399e712d46d5cbde2 2023-03-11 00:55:37,112 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 956c50b8ec45442594956fb9ad279eb9 of snapshot=snaptb-1678496122056 to region=053e1f32f2dd2afeb0e5696a70cb7982 table=testCompactionWithHFileLink 2023-03-11 00:55:37,112 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/3f5fca46b59a403d8d2a912a8513c15f_SeqId_29_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/3f5fca46b59a403d8d2a912a8513c15f_SeqId_29_ 2023-03-11 00:55:37,112 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink eadd8a5089914a5a961a28d9a005faab of snapshot=snaptb-1678496122056 to region=186abf08f502dabd8577259d44f7d8d9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,112 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/e3400e6347ef47d48ad7c60255a59e0f_SeqId_29_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/e3400e6347ef47d48ad7c60255a59e0f_SeqId_29_ 2023-03-11 00:55:37,112 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 548570c7c5334fb59847e65505210396 of snapshot=snaptb-1678496122056 to region=6f70d0cb8cdfe50a22b0232bd3d5c5b9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,124 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9c8d3bc701894145b03f6c3228555de4 of snapshot=snaptb-1678496122056 to region=186abf08f502dabd8577259d44f7d8d9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,124 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 29002ac597984b53a8b5902b72f6c8ab of snapshot=snaptb-1678496122056 to region=053e1f32f2dd2afeb0e5696a70cb7982 table=testCompactionWithHFileLink 2023-03-11 00:55:37,124 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink aa7feaf1facf454faa04e8e49998ccf5 of snapshot=snaptb-1678496122056 to region=6f70d0cb8cdfe50a22b0232bd3d5c5b9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,129 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 46813adbc92b49c58b4fc1a74dcbdd46 of snapshot=snaptb-1678496122056 to region=053e1f32f2dd2afeb0e5696a70cb7982 table=testCompactionWithHFileLink 2023-03-11 00:55:37,129 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4f688fd0b53848159bbc6f2b34605b52 of snapshot=snaptb-1678496122056 to region=6f70d0cb8cdfe50a22b0232bd3d5c5b9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,130 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 098a99876ba04417bee017780510c171 of snapshot=snaptb-1678496122056 to region=186abf08f502dabd8577259d44f7d8d9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,133 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2c3e11681c55425fab6a7ddf1913ff08 of snapshot=snaptb-1678496122056 to region=6f70d0cb8cdfe50a22b0232bd3d5c5b9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,133 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1d2766c176504303aa587bb83f179d04 of snapshot=snaptb-1678496122056 to region=186abf08f502dabd8577259d44f7d8d9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,133 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 30953997ca7a4d23913d0acc8eff85fd of snapshot=snaptb-1678496122056 to region=053e1f32f2dd2afeb0e5696a70cb7982 table=testCompactionWithHFileLink 2023-03-11 00:55:37,138 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/f040cfcde48c4a388e2b9028c2f3cb3d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/f040cfcde48c4a388e2b9028c2f3cb3d 2023-03-11 00:55:37,138 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bdd52f8480e342c99155883d20fd5ec0 of snapshot=snaptb-1678496122056 to region=6f70d0cb8cdfe50a22b0232bd3d5c5b9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,138 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/bcf0b4c7a54b4db780ab6bf7943bb2d1 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/bcf0b4c7a54b4db780ab6bf7943bb2d1 2023-03-11 00:55:37,138 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 033d4a06f89f4f64a5d06136bdd18fe4 of snapshot=snaptb-1678496122056 to region=186abf08f502dabd8577259d44f7d8d9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,138 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/c825b02fcdea487f80d14653a587fe9c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/c825b02fcdea487f80d14653a587fe9c 2023-03-11 00:55:37,138 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 285d642b34a14520997143c089e64610 of snapshot=snaptb-1678496122056 to region=053e1f32f2dd2afeb0e5696a70cb7982 table=testCompactionWithHFileLink 2023-03-11 00:55:37,141 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 10f422db8f8e4ea58b30f09f7ccb669a of snapshot=snaptb-1678496122056 to region=6f70d0cb8cdfe50a22b0232bd3d5c5b9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,141 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4be93ac838e045d9975d05c62464ace6 of snapshot=snaptb-1678496122056 to region=053e1f32f2dd2afeb0e5696a70cb7982 table=testCompactionWithHFileLink 2023-03-11 00:55:37,142 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0c0c40ea072d47408a7453d9582e974a of snapshot=snaptb-1678496122056 to region=186abf08f502dabd8577259d44f7d8d9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,145 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dbf45db339b14dce93ddb4c1fafb1d72 of snapshot=snaptb-1678496122056 to region=053e1f32f2dd2afeb0e5696a70cb7982 table=testCompactionWithHFileLink 2023-03-11 00:55:37,145 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3575de3147bd411b802b9b9bfdf3b93c of snapshot=snaptb-1678496122056 to region=6f70d0cb8cdfe50a22b0232bd3d5c5b9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,145 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fa29a3dc78264d2f9ff001bf31239001 of snapshot=snaptb-1678496122056 to region=186abf08f502dabd8577259d44f7d8d9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,148 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2af7267f1d6b4641ba22df7cb36238f9 of snapshot=snaptb-1678496122056 to region=053e1f32f2dd2afeb0e5696a70cb7982 table=testCompactionWithHFileLink 2023-03-11 00:55:37,148 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8e4fe4027e37474cb4aba5869840eba9 of snapshot=snaptb-1678496122056 to region=6f70d0cb8cdfe50a22b0232bd3d5c5b9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,149 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0bc99884f1864d9bbbd65f159febcea4 of snapshot=snaptb-1678496122056 to region=186abf08f502dabd8577259d44f7d8d9 table=testCompactionWithHFileLink 2023-03-11 00:55:37,152 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1678496122056" table: "testCompactionWithHFileLink" creation_time: 1678496122066 type: FLUSH version: 2 ttl: 0 2023-03-11 00:55:37,153 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678496137153"}]},"ts":"9223372036854775807"} 2023-03-11 00:55:37,153 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678496137153"}]},"ts":"9223372036854775807"} 2023-03-11 00:55:37,153 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678496137153"}]},"ts":"9223372036854775807"} 2023-03-11 00:55:37,155 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-11 00:55:37,155 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 053e1f32f2dd2afeb0e5696a70cb7982, NAME => 'testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 186abf08f502dabd8577259d44f7d8d9, NAME => 'testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 6f70d0cb8cdfe50a22b0232bd3d5c5b9, NAME => 'testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.', STARTKEY => '1', ENDKEY => '2'}] 2023-03-11 00:55:37,155 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496137154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496137154"}]},"ts":"1678496137154"} 2023-03-11 00:55:37,155 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496137154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496137154"}]},"ts":"1678496137154"} 2023-03-11 00:55:37,155 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496137154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496137154"}]},"ts":"1678496137154"} 2023-03-11 00:55:37,156 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-11 00:55:37,156 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-11 00:55:37,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 053e1f32f2dd2afeb0e5696a70cb7982, NAME => 'testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 186abf08f502dabd8577259d44f7d8d9, NAME => 'testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 6f70d0cb8cdfe50a22b0232bd3d5c5b9, NAME => 'testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.', STARTKEY => '1', ENDKEY => '2'}] 2023-03-11 00:55:37,157 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1678496122056 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-11 00:55:37,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678496122056" table: "testCompactionWithHFileLink" creation_time: 1678496122066 type: FLUSH version: 2 ttl: 0 ) in 524 msec 2023-03-11 00:55:37,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-11 00:55:37,247 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-11 00:55:37,247 INFO [Listener at localhost/45619] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1678496122056-1678496134482 2023-03-11 00:55:37,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1678496122056-1678496134482" 2023-03-11 00:55:37,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1678496122056-1678496134482 2023-03-11 00:55:37,256 INFO [Listener at localhost/45619] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-11 00:55:37,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-03-11 00:55:37,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-11 00:55:37,268 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-11 00:55:37,268 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496137268"}]},"ts":"1678496137268"} 2023-03-11 00:55:37,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-11 00:55:37,269 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-11 00:55:37,271 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-11 00:55:37,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, ASSIGN}] 2023-03-11 00:55:37,272 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, ASSIGN 2023-03-11 00:55:37,272 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, ASSIGN 2023-03-11 00:55:37,272 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, ASSIGN 2023-03-11 00:55:37,273 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-11 00:55:37,273 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-11 00:55:37,273 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-11 00:55:37,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-11 00:55:37,425 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=6f70d0cb8cdfe50a22b0232bd3d5c5b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:37,425 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=053e1f32f2dd2afeb0e5696a70cb7982, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:37,425 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=186abf08f502dabd8577259d44f7d8d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:37,425 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496137425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496137425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496137425"}]},"ts":"1678496137425"} 2023-03-11 00:55:37,425 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496137425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496137425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496137425"}]},"ts":"1678496137425"} 2023-03-11 00:55:37,425 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496137425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496137425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496137425"}]},"ts":"1678496137425"} 2023-03-11 00:55:37,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 6f70d0cb8cdfe50a22b0232bd3d5c5b9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:37,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 053e1f32f2dd2afeb0e5696a70cb7982, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:37,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure 186abf08f502dabd8577259d44f7d8d9, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:37,434 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-11 00:55:37,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-11 00:55:37,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 186abf08f502dabd8577259d44f7d8d9, NAME => 'testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.', STARTKEY => '2', ENDKEY => ''} 2023-03-11 00:55:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:37,582 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:37,583 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1 2023-03-11 00:55:37,583 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1 2023-03-11 00:55:37,584 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 186abf08f502dabd8577259d44f7d8d9 columnFamilyName family1 2023-03-11 00:55:37,599 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-098a99876ba04417bee017780510c171 2023-03-11 00:55:37,604 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-1d2766c176504303aa587bb83f179d04 2023-03-11 00:55:37,609 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-9c8d3bc701894145b03f6c3228555de4 2023-03-11 00:55:37,614 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-eadd8a5089914a5a961a28d9a005faab 2023-03-11 00:55:37,614 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(310): Store=186abf08f502dabd8577259d44f7d8d9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:37,614 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:37,615 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2 2023-03-11 00:55:37,615 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2 2023-03-11 00:55:37,616 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 186abf08f502dabd8577259d44f7d8d9 columnFamilyName family2 2023-03-11 00:55:37,622 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-033d4a06f89f4f64a5d06136bdd18fe4 2023-03-11 00:55:37,627 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0bc99884f1864d9bbbd65f159febcea4 2023-03-11 00:55:37,631 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0c0c40ea072d47408a7453d9582e974a 2023-03-11 00:55:37,635 DEBUG [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-fa29a3dc78264d2f9ff001bf31239001 2023-03-11 00:55:37,635 INFO [StoreOpener-186abf08f502dabd8577259d44f7d8d9-1] regionserver.HStore(310): Store=186abf08f502dabd8577259d44f7d8d9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:37,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:37,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:37,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:55:37,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:55:37,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 186abf08f502dabd8577259d44f7d8d9; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75369448, jitterRate=0.12309229373931885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:55:37,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:37,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9., pid=103, masterSystemTime=1678496137578 2023-03-11 00:55:37,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:55:37,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-11 00:55:37,641 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-11 00:55:37,641 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-11 00:55:37,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:37,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:37,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:37,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 053e1f32f2dd2afeb0e5696a70cb7982, NAME => 'testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.', STARTKEY => '', ENDKEY => '1'} 2023-03-11 00:55:37,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:37,644 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=186abf08f502dabd8577259d44f7d8d9, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:37,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:37,644 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496137643"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496137643"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496137643"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496137643"}]},"ts":"1678496137643"} 2023-03-11 00:55:37,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:37,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:37,645 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-11 00:55:37,645 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HStore(1912): 186abf08f502dabd8577259d44f7d8d9/family1 is initiating minor compaction (all files) 2023-03-11 00:55:37,645 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-11 00:55:37,645 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 186abf08f502dabd8577259d44f7d8d9/family1 in testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:37,645 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1912): 186abf08f502dabd8577259d44f7d8d9/family2 is initiating minor compaction (all files) 2023-03-11 00:55:37,645 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:37,645 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 186abf08f502dabd8577259d44f7d8d9/family2 in testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:55:37,645 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-eadd8a5089914a5a961a28d9a005faab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-9c8d3bc701894145b03f6c3228555de4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-098a99876ba04417bee017780510c171, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-1d2766c176504303aa587bb83f179d04] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp, totalSize=21.6 K 2023-03-11 00:55:37,645 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-033d4a06f89f4f64a5d06136bdd18fe4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0c0c40ea072d47408a7453d9582e974a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-fa29a3dc78264d2f9ff001bf31239001, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0bc99884f1864d9bbbd65f159febcea4] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp, totalSize=20.4 K 2023-03-11 00:55:37,646 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1 2023-03-11 00:55:37,646 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1 2023-03-11 00:55:37,646 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-033d4a06f89f4f64a5d06136bdd18fe4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115260 2023-03-11 00:55:37,647 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 053e1f32f2dd2afeb0e5696a70cb7982 columnFamilyName family1 2023-03-11 00:55:37,647 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-eadd8a5089914a5a961a28d9a005faab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115260 2023-03-11 00:55:37,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-03-11 00:55:37,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure 186abf08f502dabd8577259d44f7d8d9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 217 msec 2023-03-11 00:55:37,648 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0c0c40ea072d47408a7453d9582e974a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:37,648 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-9c8d3bc701894145b03f6c3228555de4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:37,649 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-fa29a3dc78264d2f9ff001bf31239001, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:37,649 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-098a99876ba04417bee017780510c171, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:37,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=186abf08f502dabd8577259d44f7d8d9, ASSIGN in 377 msec 2023-03-11 00:55:37,650 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0bc99884f1864d9bbbd65f159febcea4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:37,650 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-1d2766c176504303aa587bb83f179d04, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:37,661 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-29002ac597984b53a8b5902b72f6c8ab 2023-03-11 00:55:37,671 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-30953997ca7a4d23913d0acc8eff85fd 2023-03-11 00:55:37,681 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-46813adbc92b49c58b4fc1a74dcbdd46 2023-03-11 00:55:37,692 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 186abf08f502dabd8577259d44f7d8d9#family2#compaction#113 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:37,693 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-956c50b8ec45442594956fb9ad279eb9 2023-03-11 00:55:37,693 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] throttle.PressureAwareThroughputController(145): 186abf08f502dabd8577259d44f7d8d9#family1#compaction#112 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:37,693 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(310): Store=053e1f32f2dd2afeb0e5696a70cb7982/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:37,693 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:37,694 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2 2023-03-11 00:55:37,694 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2 2023-03-11 00:55:37,695 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 053e1f32f2dd2afeb0e5696a70cb7982 columnFamilyName family2 2023-03-11 00:55:37,709 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-285d642b34a14520997143c089e64610 2023-03-11 00:55:37,713 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-2af7267f1d6b4641ba22df7cb36238f9 2023-03-11 00:55:37,717 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-4be93ac838e045d9975d05c62464ace6 2023-03-11 00:55:37,724 DEBUG [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-dbf45db339b14dce93ddb4c1fafb1d72 2023-03-11 00:55:37,724 INFO [StoreOpener-053e1f32f2dd2afeb0e5696a70cb7982-1] regionserver.HStore(310): Store=053e1f32f2dd2afeb0e5696a70cb7982/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:37,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:37,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:37,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:55:37,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:55:37,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 053e1f32f2dd2afeb0e5696a70cb7982; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67630074, jitterRate=0.007766634225845337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:55:37,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:37,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982., pid=102, masterSystemTime=1678496137578 2023-03-11 00:55:37,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-11 00:55:37,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-11 00:55:37,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:37,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:37,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:37,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f70d0cb8cdfe50a22b0232bd3d5c5b9, NAME => 'testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.', STARTKEY => '1', ENDKEY => '2'} 2023-03-11 00:55:37,732 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=053e1f32f2dd2afeb0e5696a70cb7982, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:37,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:37,732 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678496137732"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496137732"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496137732"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496137732"}]},"ts":"1678496137732"} 2023-03-11 00:55:37,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:37,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:37,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:37,733 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:37,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-03-11 00:55:37,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 053e1f32f2dd2afeb0e5696a70cb7982, server=jenkins-hbase4.apache.org,38819,1678496016129 in 306 msec 2023-03-11 00:55:37,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=053e1f32f2dd2afeb0e5696a70cb7982, ASSIGN in 464 msec 2023-03-11 00:55:37,741 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 2023-03-11 00:55:37,741 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 2023-03-11 00:55:37,741 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f70d0cb8cdfe50a22b0232bd3d5c5b9 columnFamilyName family1 2023-03-11 00:55:37,752 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-2c3e11681c55425fab6a7ddf1913ff08 2023-03-11 00:55:37,760 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-4f688fd0b53848159bbc6f2b34605b52 2023-03-11 00:55:37,765 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-548570c7c5334fb59847e65505210396 2023-03-11 00:55:37,771 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-aa7feaf1facf454faa04e8e49998ccf5 2023-03-11 00:55:37,771 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(310): Store=6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:37,772 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:37,772 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2 2023-03-11 00:55:37,772 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2 2023-03-11 00:55:37,773 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f70d0cb8cdfe50a22b0232bd3d5c5b9 columnFamilyName family2 2023-03-11 00:55:37,778 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-10f422db8f8e4ea58b30f09f7ccb669a 2023-03-11 00:55:37,785 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-3575de3147bd411b802b9b9bfdf3b93c 2023-03-11 00:55:37,791 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-8e4fe4027e37474cb4aba5869840eba9 2023-03-11 00:55:37,797 DEBUG [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(539): loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-bdd52f8480e342c99155883d20fd5ec0 2023-03-11 00:55:37,798 INFO [StoreOpener-6f70d0cb8cdfe50a22b0232bd3d5c5b9-1] regionserver.HStore(310): Store=6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:37,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:37,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:37,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:55:37,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:55:37,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f70d0cb8cdfe50a22b0232bd3d5c5b9; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60885195, jitterRate=-0.09273989498615265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:55:37,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:37,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9., pid=101, masterSystemTime=1678496137578 2023-03-11 00:55:37,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-11 00:55:37,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-11 00:55:37,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:37,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:37,805 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=6f70d0cb8cdfe50a22b0232bd3d5c5b9, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:37,805 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496137804"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496137804"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496137804"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496137804"}]},"ts":"1678496137804"} 2023-03-11 00:55:37,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-03-11 00:55:37,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 6f70d0cb8cdfe50a22b0232bd3d5c5b9, server=jenkins-hbase4.apache.org,38819,1678496016129 in 379 msec 2023-03-11 00:55:37,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-03-11 00:55:37,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f70d0cb8cdfe50a22b0232bd3d5c5b9, ASSIGN in 536 msec 2023-03-11 00:55:37,809 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496137809"}]},"ts":"1678496137809"} 2023-03-11 00:55:37,810 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-11 00:55:37,811 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-11 00:55:37,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 551 msec 2023-03-11 00:55:37,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-11 00:55:37,871 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-11 00:55:37,881 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:37,887 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:37,896 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:37,897 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:37,903 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 00:55:37,913 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-11 00:55:37,913 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:37,914 DEBUG [Listener at localhost/45619] zookeeper.ReadOnlyZKClient(139): Connect 0x28b43b23 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:55:37,919 DEBUG [Listener at localhost/45619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28189b88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:55:37,919 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:37,919 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:37,919 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:38,413 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303110f9be2ba003a463fbedc733ba71b94b8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303110f9be2ba003a463fbedc733ba71b94b8 2023-03-11 00:55:38,416 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:38,418 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311f76c727195ae40bb937a536c54a9762a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311f76c727195ae40bb937a536c54a9762a 2023-03-11 00:55:38,420 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:38,428 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:55:38,432 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32838, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:55:38,442 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:55:38,445 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37028, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:55:38,458 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/4f4e42960c784ed8916d90a0ca349146 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-11 00:55:38,459 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=32 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/4f4e42960c784ed8916d90a0ca349146}] 2023-03-11 00:55:38,460 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/645641cee16846a8a701865cf7cbc7b6 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-11 00:55:38,461 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/645641cee16846a8a701865cf7cbc7b6}] 2023-03-11 00:55:38,464 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/4f4e42960c784ed8916d90a0ca349146 for inclusion in 053e1f32f2dd2afeb0e5696a70cb7982/family1 2023-03-11 00:55:38,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/645641cee16846a8a701865cf7cbc7b6 for inclusion in 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 2023-03-11 00:55:38,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-11 00:55:38,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last=1 2023-03-11 00:55:38,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-11 00:55:38,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-11 00:55:38,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:38,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:38,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/4f4e42960c784ed8916d90a0ca349146 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__4kshl968g26l77ougpq2lbdqam5v44hl6r92a02l6ska8vta800ejit3hf8he9rk/family1/4f4e42960c784ed8916d90a0ca349146 2023-03-11 00:55:38,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/645641cee16846a8a701865cf7cbc7b6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__96djehg91q97t95gn5ne03hlplg4eirrejo5voicc5kgae40a83pt4njted4hlp9/family1/645641cee16846a8a701865cf7cbc7b6 2023-03-11 00:55:38,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__4kshl968g26l77ougpq2lbdqam5v44hl6r92a02l6ska8vta800ejit3hf8he9rk/family1/4f4e42960c784ed8916d90a0ca349146 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/16096be694b54c10b5a2317a8288e764_SeqId_34_ 2023-03-11 00:55:38,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__96djehg91q97t95gn5ne03hlplg4eirrejo5voicc5kgae40a83pt4njted4hlp9/family1/645641cee16846a8a701865cf7cbc7b6 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/ca91d02350dc488bb37e02afc4669ede_SeqId_34_ 2023-03-11 00:55:38,470 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__4kshl968g26l77ougpq2lbdqam5v44hl6r92a02l6ska8vta800ejit3hf8he9rk/family1/4f4e42960c784ed8916d90a0ca349146 into 053e1f32f2dd2afeb0e5696a70cb7982/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/16096be694b54c10b5a2317a8288e764_SeqId_34_ - updating store file list. 2023-03-11 00:55:38,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__96djehg91q97t95gn5ne03hlplg4eirrejo5voicc5kgae40a83pt4njted4hlp9/family1/645641cee16846a8a701865cf7cbc7b6 into 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/ca91d02350dc488bb37e02afc4669ede_SeqId_34_ - updating store file list. 2023-03-11 00:55:38,473 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/16096be694b54c10b5a2317a8288e764_SeqId_34_ into 053e1f32f2dd2afeb0e5696a70cb7982/family1 2023-03-11 00:55:38,473 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__4kshl968g26l77ougpq2lbdqam5v44hl6r92a02l6ska8vta800ejit3hf8he9rk/family1/4f4e42960c784ed8916d90a0ca349146 into 053e1f32f2dd2afeb0e5696a70cb7982/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/16096be694b54c10b5a2317a8288e764_SeqId_34_) 2023-03-11 00:55:38,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__4kshl968g26l77ougpq2lbdqam5v44hl6r92a02l6ska8vta800ejit3hf8he9rk/family1/4f4e42960c784ed8916d90a0ca349146 2023-03-11 00:55:38,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/ca91d02350dc488bb37e02afc4669ede_SeqId_34_ into 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 2023-03-11 00:55:38,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:38,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__96djehg91q97t95gn5ne03hlplg4eirrejo5voicc5kgae40a83pt4njted4hlp9/family1/645641cee16846a8a701865cf7cbc7b6 into 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/ca91d02350dc488bb37e02afc4669ede_SeqId_34_) 2023-03-11 00:55:38,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__96djehg91q97t95gn5ne03hlplg4eirrejo5voicc5kgae40a83pt4njted4hlp9/family1/645641cee16846a8a701865cf7cbc7b6 2023-03-11 00:55:38,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-11 00:55:38,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.HStore(1912): 053e1f32f2dd2afeb0e5696a70cb7982/family1 is initiating minor compaction (all files) 2023-03-11 00:55:38,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@30932bb2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-11 00:55:38,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:38,478 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:38,478 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:38,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-11 00:55:38,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 is initiating minor compaction (all files) 2023-03-11 00:55:38,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@e59d8fa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-03-11 00:55:38,479 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303110bce642178f448eab384eb7a61cb329b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303110bce642178f448eab384eb7a61cb329b 2023-03-11 00:55:38,480 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:38,480 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230311638b71312f27478ba384c343cf242e18 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230311638b71312f27478ba384c343cf242e18 2023-03-11 00:55:38,481 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:38,481 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230311690081347528497b9fa16b2a8dd62a2d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230311690081347528497b9fa16b2a8dd62a2d 2023-03-11 00:55:38,482 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303115756febdcdbf4b999de7cd8c523988c5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303115756febdcdbf4b999de7cd8c523988c5 2023-03-11 00:55:38,482 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230311efb20048b83f4aaa9ede919244a03f0b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230311efb20048b83f4aaa9ede919244a03f0b 2023-03-11 00:55:38,482 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 00:55:38,482 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311' 2023-03-11 00:55:38,483 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303116b231f2776864a47b304ed986ae2eb33 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303116b231f2776864a47b304ed986ae2eb33 2023-03-11 00:55:38,483 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:38,484 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023031191c5858b6023453698850b6c07d3b7bb to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023031191c5858b6023453698850b6c07d3b7bb 2023-03-11 00:55:38,484 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230311e21b6d88f9724146a471b5550c202143 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230311e21b6d88f9724146a471b5550c202143 2023-03-11 00:55:38,484 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 00:55:38,484 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311' 2023-03-11 00:55:38,485 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:38,518 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family2/9bb75cc399db410a908727be5cf510e7 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/9bb75cc399db410a908727be5cf510e7 2023-03-11 00:55:38,522 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-11 00:55:38,522 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 186abf08f502dabd8577259d44f7d8d9/family2 of 186abf08f502dabd8577259d44f7d8d9 into 9bb75cc399db410a908727be5cf510e7(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:55:38,522 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:38,523 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9., storeName=186abf08f502dabd8577259d44f7d8d9/family2, priority=12, startTime=1678496137641; duration=0sec 2023-03-11 00:55:38,523 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-03-11 00:55:38,523 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 053e1f32f2dd2afeb0e5696a70cb7982/family1 in testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:38,523 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-956c50b8ec45442594956fb9ad279eb9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-29002ac597984b53a8b5902b72f6c8ab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-46813adbc92b49c58b4fc1a74dcbdd46, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-30953997ca7a4d23913d0acc8eff85fd, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/16096be694b54c10b5a2317a8288e764_SeqId_34_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp, totalSize=28.9 K 2023-03-11 00:55:38,523 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-956c50b8ec45442594956fb9ad279eb9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115257 2023-03-11 00:55:38,524 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-29002ac597984b53a8b5902b72f6c8ab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:38,524 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-46813adbc92b49c58b4fc1a74dcbdd46, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:38,525 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-30953997ca7a4d23913d0acc8eff85fd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:38,525 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 16096be694b54c10b5a2317a8288e764_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1678496115257 2023-03-11 00:55:38,538 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 053e1f32f2dd2afeb0e5696a70cb7982#family1#compaction#114 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:38,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-033d4a06f89f4f64a5d06136bdd18fe4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0c0c40ea072d47408a7453d9582e974a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-fa29a3dc78264d2f9ff001bf31239001, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0bc99884f1864d9bbbd65f159febcea4] to archive 2023-03-11 00:55:38,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:38,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-033d4a06f89f4f64a5d06136bdd18fe4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-033d4a06f89f4f64a5d06136bdd18fe4 2023-03-11 00:55:38,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0c0c40ea072d47408a7453d9582e974a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0c0c40ea072d47408a7453d9582e974a 2023-03-11 00:55:38,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-fa29a3dc78264d2f9ff001bf31239001 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-fa29a3dc78264d2f9ff001bf31239001 2023-03-11 00:55:38,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0bc99884f1864d9bbbd65f159febcea4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family2/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-0bc99884f1864d9bbbd65f159febcea4 2023-03-11 00:55:38,810 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031105591d209d6f4bef981a7413dd00745b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031105591d209d6f4bef981a7413dd00745b 2023-03-11 00:55:38,811 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:38,834 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/d4f535ea3ae1470297863feec440bee7 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-11 00:55:38,835 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/d4f535ea3ae1470297863feec440bee7}] 2023-03-11 00:55:38,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/d4f535ea3ae1470297863feec440bee7 for inclusion in 186abf08f502dabd8577259d44f7d8d9/family1 2023-03-11 00:55:38,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-11 00:55:38,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-11 00:55:38,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:38,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/d4f535ea3ae1470297863feec440bee7 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__6svjunl4f3josfo6s62di5bqbt57dbgjifckfodn1gjsqqku00j2j2nlsau48o56/family1/d4f535ea3ae1470297863feec440bee7 2023-03-11 00:55:38,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__6svjunl4f3josfo6s62di5bqbt57dbgjifckfodn1gjsqqku00j2j2nlsau48o56/family1/d4f535ea3ae1470297863feec440bee7 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/091d951365904e57a4c4b8a4febbff1e_SeqId_35_ 2023-03-11 00:55:38,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__6svjunl4f3josfo6s62di5bqbt57dbgjifckfodn1gjsqqku00j2j2nlsau48o56/family1/d4f535ea3ae1470297863feec440bee7 into 186abf08f502dabd8577259d44f7d8d9/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/091d951365904e57a4c4b8a4febbff1e_SeqId_35_ - updating store file list. 2023-03-11 00:55:38,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/091d951365904e57a4c4b8a4febbff1e_SeqId_35_ into 186abf08f502dabd8577259d44f7d8d9/family1 2023-03-11 00:55:38,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__6svjunl4f3josfo6s62di5bqbt57dbgjifckfodn1gjsqqku00j2j2nlsau48o56/family1/d4f535ea3ae1470297863feec440bee7 into 186abf08f502dabd8577259d44f7d8d9/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/091d951365904e57a4c4b8a4febbff1e_SeqId_35_) 2023-03-11 00:55:38,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testCompactionWithHFileLink__6svjunl4f3josfo6s62di5bqbt57dbgjifckfodn1gjsqqku00j2j2nlsau48o56/family1/d4f535ea3ae1470297863feec440bee7 2023-03-11 00:55:38,846 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:38,847 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:38,848 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230311256343a0c4764e11abff441b975d0033 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230311256343a0c4764e11abff441b975d0033 2023-03-11 00:55:38,849 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303112ebe3904fa1846a3ac2f07fb4dbdbfbd to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303112ebe3904fa1846a3ac2f07fb4dbdbfbd 2023-03-11 00:55:38,850 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230311ace8c856047e4bb3adccbb4fa0d55303 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230311ace8c856047e4bb3adccbb4fa0d55303 2023-03-11 00:55:38,851 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230311cb982ae2531e4cfca4d434fef9a98b95 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230311cb982ae2531e4cfca4d434fef9a98b95 2023-03-11 00:55:38,851 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 00:55:38,851 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311' 2023-03-11 00:55:38,851 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 00:55:38,851 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-11 00:55:38,854 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:38,856 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:38,859 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:38,860 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:38,865 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:38,866 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:38,881 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 244) - Thread LEAK? -, OpenFileDescriptor=759 (was 615) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=150 (was 176), ProcessCount=170 (was 170), AvailableMemoryMB=5408 (was 5464) 2023-03-11 00:55:38,893 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=285, OpenFileDescriptor=759, MaxFileDescriptor=60000, SystemLoadAverage=150, ProcessCount=170, AvailableMemoryMB=5408 2023-03-11 00:55:38,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-03-11 00:55:38,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-11 00:55:38,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-11 00:55:38,904 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-11 00:55:38,906 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 7 msec 2023-03-11 00:55:38,919 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/.tmp/family1/7de82077ffc44721a8867a0a3e33cae8 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/7de82077ffc44721a8867a0a3e33cae8 2023-03-11 00:55:38,925 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 186abf08f502dabd8577259d44f7d8d9/family1 of 186abf08f502dabd8577259d44f7d8d9 into 7de82077ffc44721a8867a0a3e33cae8(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:38,925 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:55:38,925 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9., storeName=186abf08f502dabd8577259d44f7d8d9/family1, priority=12, startTime=1678496137641; duration=1sec 2023-03-11 00:55:38,925 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-11 00:55:38,925 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 in testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:38,925 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-548570c7c5334fb59847e65505210396, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-aa7feaf1facf454faa04e8e49998ccf5, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-4f688fd0b53848159bbc6f2b34605b52, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-2c3e11681c55425fab6a7ddf1913ff08, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/ca91d02350dc488bb37e02afc4669ede_SeqId_34_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp, totalSize=28.9 K 2023-03-11 00:55:38,926 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-548570c7c5334fb59847e65505210396, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115259 2023-03-11 00:55:38,926 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-aa7feaf1facf454faa04e8e49998ccf5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:38,927 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-4f688fd0b53848159bbc6f2b34605b52, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:38,927 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-2c3e11681c55425fab6a7ddf1913ff08, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:38,927 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting ca91d02350dc488bb37e02afc4669ede_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1678496115259 2023-03-11 00:55:38,940 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] throttle.PressureAwareThroughputController(145): 6f70d0cb8cdfe50a22b0232bd3d5c5b9#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:38,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-eadd8a5089914a5a961a28d9a005faab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-9c8d3bc701894145b03f6c3228555de4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-098a99876ba04417bee017780510c171, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-1d2766c176504303aa587bb83f179d04] to archive 2023-03-11 00:55:38,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:38,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-eadd8a5089914a5a961a28d9a005faab to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-eadd8a5089914a5a961a28d9a005faab 2023-03-11 00:55:38,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-9c8d3bc701894145b03f6c3228555de4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-9c8d3bc701894145b03f6c3228555de4 2023-03-11 00:55:38,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-098a99876ba04417bee017780510c171 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-098a99876ba04417bee017780510c171 2023-03-11 00:55:38,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-1d2766c176504303aa587bb83f179d04 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/family1/testCompactionWithHFileLink=186abf08f502dabd8577259d44f7d8d9-1d2766c176504303aa587bb83f179d04 2023-03-11 00:55:39,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-11 00:55:39,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-11 00:55:39,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-11 00:55:39,006 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:55:39,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-11 00:55:39,007 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:55:39,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 00:55:39,009 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3 2023-03-11 00:55:39,009 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:55:39,009 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872 2023-03-11 00:55:39,009 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3 empty. 2023-03-11 00:55:39,009 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6 empty. 2023-03-11 00:55:39,009 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872 empty. 2023-03-11 00:55:39,010 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3 2023-03-11 00:55:39,010 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872 2023-03-11 00:55:39,010 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:55:39,010 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-11 00:55:39,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 00:55:39,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 00:55:39,359 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family1/54101fea97db49229cda12472a867985 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/54101fea97db49229cda12472a867985 2023-03-11 00:55:39,365 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1 of 6f70d0cb8cdfe50a22b0232bd3d5c5b9 into 54101fea97db49229cda12472a867985(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:55:39,365 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:39,365 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1678496138478; duration=0sec 2023-03-11 00:55:39,365 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-11 00:55:39,365 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-11 00:55:39,367 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-11 00:55:39,368 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HStore(1912): 053e1f32f2dd2afeb0e5696a70cb7982/family2 is initiating minor compaction (all files) 2023-03-11 00:55:39,368 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 053e1f32f2dd2afeb0e5696a70cb7982/family2 in testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:55:39,368 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-285d642b34a14520997143c089e64610, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-4be93ac838e045d9975d05c62464ace6, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-dbf45db339b14dce93ddb4c1fafb1d72, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-2af7267f1d6b4641ba22df7cb36238f9] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp, totalSize=20.4 K 2023-03-11 00:55:39,370 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-285d642b34a14520997143c089e64610, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115257 2023-03-11 00:55:39,371 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-4be93ac838e045d9975d05c62464ace6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:39,372 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-dbf45db339b14dce93ddb4c1fafb1d72, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:39,372 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-2af7267f1d6b4641ba22df7cb36238f9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:39,385 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] throttle.PressureAwareThroughputController(145): 053e1f32f2dd2afeb0e5696a70cb7982#family2#compaction#116 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:39,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-548570c7c5334fb59847e65505210396, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-aa7feaf1facf454faa04e8e49998ccf5, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-4f688fd0b53848159bbc6f2b34605b52, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-2c3e11681c55425fab6a7ddf1913ff08, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/ca91d02350dc488bb37e02afc4669ede_SeqId_34_] to archive 2023-03-11 00:55:39,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:39,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-548570c7c5334fb59847e65505210396 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-548570c7c5334fb59847e65505210396 2023-03-11 00:55:39,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-aa7feaf1facf454faa04e8e49998ccf5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-aa7feaf1facf454faa04e8e49998ccf5 2023-03-11 00:55:39,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-4f688fd0b53848159bbc6f2b34605b52 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-4f688fd0b53848159bbc6f2b34605b52 2023-03-11 00:55:39,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-2c3e11681c55425fab6a7ddf1913ff08 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-2c3e11681c55425fab6a7ddf1913ff08 2023-03-11 00:55:39,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/ca91d02350dc488bb37e02afc4669ede_SeqId_34_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family1/ca91d02350dc488bb37e02afc4669ede_SeqId_34_ 2023-03-11 00:55:39,416 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-11 00:55:39,418 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 439fc7d2553cd76c08e8dd28cd3ba7b6, NAME => 'ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:55:39,418 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => d4d84b511dc532e521aa954b19da2872, NAME => 'ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:55:39,418 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1e8871741be4163356575157eead69a3, NAME => 'ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:55:39,424 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:39,424 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 1e8871741be4163356575157eead69a3, disabling compactions & flushes 2023-03-11 00:55:39,424 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:39,424 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:39,424 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. after waiting 0 ms 2023-03-11 00:55:39,424 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:39,424 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:39,424 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:55:39,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 00:55:39,754 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family1/c161cd1e3c4649559a96d0218c40f493 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/c161cd1e3c4649559a96d0218c40f493 2023-03-11 00:55:39,758 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 053e1f32f2dd2afeb0e5696a70cb7982/family1 of 053e1f32f2dd2afeb0e5696a70cb7982 into c161cd1e3c4649559a96d0218c40f493(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:39,759 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:39,759 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1678496138476; duration=1sec 2023-03-11 00:55:39,759 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-11 00:55:39,759 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-11 00:55:39,761 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-11 00:55:39,761 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1912): 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2 is initiating minor compaction (all files) 2023-03-11 00:55:39,761 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2 in testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:55:39,761 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-bdd52f8480e342c99155883d20fd5ec0, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-10f422db8f8e4ea58b30f09f7ccb669a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-3575de3147bd411b802b9b9bfdf3b93c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-8e4fe4027e37474cb4aba5869840eba9] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp, totalSize=20.4 K 2023-03-11 00:55:39,761 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-bdd52f8480e342c99155883d20fd5ec0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496115259 2023-03-11 00:55:39,762 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-10f422db8f8e4ea58b30f09f7ccb669a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496117044 2023-03-11 00:55:39,762 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-3575de3147bd411b802b9b9bfdf3b93c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496118863 2023-03-11 00:55:39,763 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-8e4fe4027e37474cb4aba5869840eba9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496120664 2023-03-11 00:55:39,774 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6f70d0cb8cdfe50a22b0232bd3d5c5b9#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:39,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-956c50b8ec45442594956fb9ad279eb9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-29002ac597984b53a8b5902b72f6c8ab, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-46813adbc92b49c58b4fc1a74dcbdd46, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-30953997ca7a4d23913d0acc8eff85fd, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/16096be694b54c10b5a2317a8288e764_SeqId_34_] to archive 2023-03-11 00:55:39,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:39,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-956c50b8ec45442594956fb9ad279eb9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-956c50b8ec45442594956fb9ad279eb9 2023-03-11 00:55:39,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-29002ac597984b53a8b5902b72f6c8ab to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-29002ac597984b53a8b5902b72f6c8ab 2023-03-11 00:55:39,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-46813adbc92b49c58b4fc1a74dcbdd46 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-46813adbc92b49c58b4fc1a74dcbdd46 2023-03-11 00:55:39,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-30953997ca7a4d23913d0acc8eff85fd to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-30953997ca7a4d23913d0acc8eff85fd 2023-03-11 00:55:39,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/16096be694b54c10b5a2317a8288e764_SeqId_34_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family1/16096be694b54c10b5a2317a8288e764_SeqId_34_ 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 439fc7d2553cd76c08e8dd28cd3ba7b6, disabling compactions & flushes 2023-03-11 00:55:39,824 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. after waiting 0 ms 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing d4d84b511dc532e521aa954b19da2872, disabling compactions & flushes 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:39,824 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:39,824 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. after waiting 0 ms 2023-03-11 00:55:39,824 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:39,824 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:39,825 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:55:39,826 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:55:39,827 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678496139827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496139827"}]},"ts":"1678496139827"} 2023-03-11 00:55:39,827 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678496139827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496139827"}]},"ts":"1678496139827"} 2023-03-11 00:55:39,827 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678496139827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496139827"}]},"ts":"1678496139827"} 2023-03-11 00:55:39,829 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-11 00:55:39,830 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:55:39,830 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496139830"}]},"ts":"1678496139830"} 2023-03-11 00:55:39,831 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-11 00:55:39,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1e8871741be4163356575157eead69a3, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=439fc7d2553cd76c08e8dd28cd3ba7b6, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d4d84b511dc532e521aa954b19da2872, ASSIGN}] 2023-03-11 00:55:39,837 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d4d84b511dc532e521aa954b19da2872, ASSIGN 2023-03-11 00:55:39,837 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=439fc7d2553cd76c08e8dd28cd3ba7b6, ASSIGN 2023-03-11 00:55:39,837 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1e8871741be4163356575157eead69a3, ASSIGN 2023-03-11 00:55:39,837 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d4d84b511dc532e521aa954b19da2872, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:55:39,837 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=439fc7d2553cd76c08e8dd28cd3ba7b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:55:39,838 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1e8871741be4163356575157eead69a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:55:39,871 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:55:39,990 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=1e8871741be4163356575157eead69a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:39,990 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=d4d84b511dc532e521aa954b19da2872, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:39,990 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=439fc7d2553cd76c08e8dd28cd3ba7b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:39,990 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678496139990"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496139990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496139990"}]},"ts":"1678496139990"} 2023-03-11 00:55:39,990 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678496139990"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496139990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496139990"}]},"ts":"1678496139990"} 2023-03-11 00:55:39,990 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678496139990"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496139990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496139990"}]},"ts":"1678496139990"} 2023-03-11 00:55:39,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 1e8871741be4163356575157eead69a3, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:39,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 439fc7d2553cd76c08e8dd28cd3ba7b6, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:39,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure d4d84b511dc532e521aa954b19da2872, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:40,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 00:55:40,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:40,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 439fc7d2553cd76c08e8dd28cd3ba7b6, NAME => 'ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6.', STARTKEY => '1', ENDKEY => '2'} 2023-03-11 00:55:40,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:55:40,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:40,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:55:40,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:55:40,148 INFO [StoreOpener-439fc7d2553cd76c08e8dd28cd3ba7b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:55:40,149 DEBUG [StoreOpener-439fc7d2553cd76c08e8dd28cd3ba7b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1 2023-03-11 00:55:40,149 DEBUG [StoreOpener-439fc7d2553cd76c08e8dd28cd3ba7b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1 2023-03-11 00:55:40,150 INFO [StoreOpener-439fc7d2553cd76c08e8dd28cd3ba7b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 439fc7d2553cd76c08e8dd28cd3ba7b6 columnFamilyName family1 2023-03-11 00:55:40,151 INFO [StoreOpener-439fc7d2553cd76c08e8dd28cd3ba7b6-1] regionserver.HStore(310): Store=439fc7d2553cd76c08e8dd28cd3ba7b6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:40,151 INFO [StoreOpener-439fc7d2553cd76c08e8dd28cd3ba7b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:55:40,152 DEBUG [StoreOpener-439fc7d2553cd76c08e8dd28cd3ba7b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2 2023-03-11 00:55:40,152 DEBUG [StoreOpener-439fc7d2553cd76c08e8dd28cd3ba7b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2 2023-03-11 00:55:40,153 INFO [StoreOpener-439fc7d2553cd76c08e8dd28cd3ba7b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 439fc7d2553cd76c08e8dd28cd3ba7b6 columnFamilyName family2 2023-03-11 00:55:40,154 INFO [StoreOpener-439fc7d2553cd76c08e8dd28cd3ba7b6-1] regionserver.HStore(310): Store=439fc7d2553cd76c08e8dd28cd3ba7b6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:40,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:55:40,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:55:40,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:55:40,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:55:40,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:55:40,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 439fc7d2553cd76c08e8dd28cd3ba7b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65020695, jitterRate=-0.031116142868995667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:55:40,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:55:40,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6., pid=110, masterSystemTime=1678496140143 2023-03-11 00:55:40,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:40,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:40,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:40,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d4d84b511dc532e521aa954b19da2872, NAME => 'ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872.', STARTKEY => '2', ENDKEY => ''} 2023-03-11 00:55:40,161 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=439fc7d2553cd76c08e8dd28cd3ba7b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:40,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction d4d84b511dc532e521aa954b19da2872 2023-03-11 00:55:40,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:40,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678496140161"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496140161"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496140161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496140161"}]},"ts":"1678496140161"} 2023-03-11 00:55:40,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d4d84b511dc532e521aa954b19da2872 2023-03-11 00:55:40,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d4d84b511dc532e521aa954b19da2872 2023-03-11 00:55:40,162 INFO [StoreOpener-d4d84b511dc532e521aa954b19da2872-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d4d84b511dc532e521aa954b19da2872 2023-03-11 00:55:40,164 DEBUG [StoreOpener-d4d84b511dc532e521aa954b19da2872-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1 2023-03-11 00:55:40,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=107 2023-03-11 00:55:40,164 DEBUG [StoreOpener-d4d84b511dc532e521aa954b19da2872-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1 2023-03-11 00:55:40,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 439fc7d2553cd76c08e8dd28cd3ba7b6, server=jenkins-hbase4.apache.org,38819,1678496016129 in 170 msec 2023-03-11 00:55:40,164 INFO [StoreOpener-d4d84b511dc532e521aa954b19da2872-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4d84b511dc532e521aa954b19da2872 columnFamilyName family1 2023-03-11 00:55:40,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=439fc7d2553cd76c08e8dd28cd3ba7b6, ASSIGN in 329 msec 2023-03-11 00:55:40,165 INFO [StoreOpener-d4d84b511dc532e521aa954b19da2872-1] regionserver.HStore(310): Store=d4d84b511dc532e521aa954b19da2872/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:40,165 INFO [StoreOpener-d4d84b511dc532e521aa954b19da2872-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d4d84b511dc532e521aa954b19da2872 2023-03-11 00:55:40,166 DEBUG [StoreOpener-d4d84b511dc532e521aa954b19da2872-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2 2023-03-11 00:55:40,166 DEBUG [StoreOpener-d4d84b511dc532e521aa954b19da2872-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2 2023-03-11 00:55:40,166 INFO [StoreOpener-d4d84b511dc532e521aa954b19da2872-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4d84b511dc532e521aa954b19da2872 columnFamilyName family2 2023-03-11 00:55:40,167 INFO [StoreOpener-d4d84b511dc532e521aa954b19da2872-1] regionserver.HStore(310): Store=d4d84b511dc532e521aa954b19da2872/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:40,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872 2023-03-11 00:55:40,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872 2023-03-11 00:55:40,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:55:40,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d4d84b511dc532e521aa954b19da2872 2023-03-11 00:55:40,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:55:40,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d4d84b511dc532e521aa954b19da2872; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60551643, jitterRate=-0.09771020710468292}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:55:40,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:55:40,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872., pid=111, masterSystemTime=1678496140143 2023-03-11 00:55:40,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:40,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:40,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:40,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e8871741be4163356575157eead69a3, NAME => 'ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3.', STARTKEY => '', ENDKEY => '1'} 2023-03-11 00:55:40,174 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=d4d84b511dc532e521aa954b19da2872, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:40,174 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678496140173"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496140173"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496140173"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496140173"}]},"ts":"1678496140173"} 2023-03-11 00:55:40,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1e8871741be4163356575157eead69a3 2023-03-11 00:55:40,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:40,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e8871741be4163356575157eead69a3 2023-03-11 00:55:40,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e8871741be4163356575157eead69a3 2023-03-11 00:55:40,175 INFO [StoreOpener-1e8871741be4163356575157eead69a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1e8871741be4163356575157eead69a3 2023-03-11 00:55:40,176 DEBUG [StoreOpener-1e8871741be4163356575157eead69a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1 2023-03-11 00:55:40,176 DEBUG [StoreOpener-1e8871741be4163356575157eead69a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1 2023-03-11 00:55:40,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=108 2023-03-11 00:55:40,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure d4d84b511dc532e521aa954b19da2872, server=jenkins-hbase4.apache.org,38819,1678496016129 in 183 msec 2023-03-11 00:55:40,176 INFO [StoreOpener-1e8871741be4163356575157eead69a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e8871741be4163356575157eead69a3 columnFamilyName family1 2023-03-11 00:55:40,177 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d4d84b511dc532e521aa954b19da2872, ASSIGN in 341 msec 2023-03-11 00:55:40,177 INFO [StoreOpener-1e8871741be4163356575157eead69a3-1] regionserver.HStore(310): Store=1e8871741be4163356575157eead69a3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:40,177 INFO [StoreOpener-1e8871741be4163356575157eead69a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1e8871741be4163356575157eead69a3 2023-03-11 00:55:40,178 DEBUG [StoreOpener-1e8871741be4163356575157eead69a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2 2023-03-11 00:55:40,178 DEBUG [StoreOpener-1e8871741be4163356575157eead69a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2 2023-03-11 00:55:40,179 INFO [StoreOpener-1e8871741be4163356575157eead69a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e8871741be4163356575157eead69a3 columnFamilyName family2 2023-03-11 00:55:40,179 INFO [StoreOpener-1e8871741be4163356575157eead69a3-1] regionserver.HStore(310): Store=1e8871741be4163356575157eead69a3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:40,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3 2023-03-11 00:55:40,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3 2023-03-11 00:55:40,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:55:40,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e8871741be4163356575157eead69a3 2023-03-11 00:55:40,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:55:40,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e8871741be4163356575157eead69a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73744823, jitterRate=0.0988834947347641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:55:40,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:55:40,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3., pid=109, masterSystemTime=1678496140143 2023-03-11 00:55:40,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:40,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:40,187 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=1e8871741be4163356575157eead69a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:40,187 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678496140187"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496140187"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496140187"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496140187"}]},"ts":"1678496140187"} 2023-03-11 00:55:40,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-03-11 00:55:40,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 1e8871741be4163356575157eead69a3, server=jenkins-hbase4.apache.org,38819,1678496016129 in 196 msec 2023-03-11 00:55:40,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-03-11 00:55:40,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1e8871741be4163356575157eead69a3, ASSIGN in 354 msec 2023-03-11 00:55:40,191 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:55:40,191 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496140191"}]},"ts":"1678496140191"} 2023-03-11 00:55:40,192 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-11 00:55:40,194 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:55:40,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1900 sec 2023-03-11 00:55:40,608 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/.tmp/family2/3ea66163780d43a498f4c0132bd07460 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/3ea66163780d43a498f4c0132bd07460 2023-03-11 00:55:40,612 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 053e1f32f2dd2afeb0e5696a70cb7982/family2 of 053e1f32f2dd2afeb0e5696a70cb7982 into 3ea66163780d43a498f4c0132bd07460(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:40,612 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:55:40,612 INFO [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982., storeName=053e1f32f2dd2afeb0e5696a70cb7982/family2, priority=12, startTime=1678496137730; duration=1sec 2023-03-11 00:55:40,612 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-11 00:55:40,613 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-11 00:55:40,613 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-11 00:55:40,613 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-11 00:55:40,613 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. because compaction request was cancelled 2023-03-11 00:55:40,613 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-11 00:55:40,614 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-11 00:55:40,614 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-11 00:55:40,614 DEBUG [RS:0;jenkins-hbase4:38819-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. because compaction request was cancelled 2023-03-11 00:55:40,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-285d642b34a14520997143c089e64610, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-4be93ac838e045d9975d05c62464ace6, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-dbf45db339b14dce93ddb4c1fafb1d72, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-2af7267f1d6b4641ba22df7cb36238f9] to archive 2023-03-11 00:55:40,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:40,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-285d642b34a14520997143c089e64610 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-285d642b34a14520997143c089e64610 2023-03-11 00:55:40,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-4be93ac838e045d9975d05c62464ace6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-4be93ac838e045d9975d05c62464ace6 2023-03-11 00:55:40,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-dbf45db339b14dce93ddb4c1fafb1d72 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-dbf45db339b14dce93ddb4c1fafb1d72 2023-03-11 00:55:40,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-2af7267f1d6b4641ba22df7cb36238f9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/family2/testCompactionWithHFileLink=053e1f32f2dd2afeb0e5696a70cb7982-2af7267f1d6b4641ba22df7cb36238f9 2023-03-11 00:55:40,990 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/.tmp/family2/cdeef87302ee448e8dcabac0e63b3520 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/cdeef87302ee448e8dcabac0e63b3520 2023-03-11 00:55:40,995 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2 of 6f70d0cb8cdfe50a22b0232bd3d5c5b9 into cdeef87302ee448e8dcabac0e63b3520(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:40,995 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:55:40,996 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9., storeName=6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2, priority=12, startTime=1678496137803; duration=1sec 2023-03-11 00:55:40,996 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:55:41,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-bdd52f8480e342c99155883d20fd5ec0, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-10f422db8f8e4ea58b30f09f7ccb669a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-3575de3147bd411b802b9b9bfdf3b93c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-8e4fe4027e37474cb4aba5869840eba9] to archive 2023-03-11 00:55:41,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:41,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-bdd52f8480e342c99155883d20fd5ec0 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-bdd52f8480e342c99155883d20fd5ec0 2023-03-11 00:55:41,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-10f422db8f8e4ea58b30f09f7ccb669a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-10f422db8f8e4ea58b30f09f7ccb669a 2023-03-11 00:55:41,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-3575de3147bd411b802b9b9bfdf3b93c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-3575de3147bd411b802b9b9bfdf3b93c 2023-03-11 00:55:41,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-8e4fe4027e37474cb4aba5869840eba9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/family2/testCompactionWithHFileLink=6f70d0cb8cdfe50a22b0232bd3d5c5b9-8e4fe4027e37474cb4aba5869840eba9 2023-03-11 00:55:41,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 00:55:41,112 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-11 00:55:41,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:41,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:41,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:41,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:41,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-11 00:55:41,122 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-11 00:55:41,122 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:41,122 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-11 00:55:41,122 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-11 00:55:41,122 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:41,122 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:41,123 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:41,123 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:41,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:41,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:41,124 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:41,124 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:41,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:41,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:41,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:41,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:41,124 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-11 00:55:41,124 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-11 00:55:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-11 00:55:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-11 00:55:41,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:41,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:41,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. started... 2023-03-11 00:55:41,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:55:41,127 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:41,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. started... 2023-03-11 00:55:41,125 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. started... 2023-03-11 00:55:41,127 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d4d84b511dc532e521aa954b19da2872 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 00:55:41,127 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 439fc7d2553cd76c08e8dd28cd3ba7b6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 00:55:41,127 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1e8871741be4163356575157eead69a3 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 00:55:41,546 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311248acb545fc445ad8e9a17632162cdf5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230311248acb545fc445ad8e9a17632162cdf5 2023-03-11 00:55:41,546 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311e0215851e2904a68acc203e0ff2068d6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230311e0215851e2904a68acc203e0ff2068d6 2023-03-11 00:55:41,547 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303115fac4dcf56714dc5994d3b540a4bc573 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303115fac4dcf56714dc5994d3b540a4bc573 2023-03-11 00:55:41,551 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/1c4104787c734652a3aec350d3a9f812 2023-03-11 00:55:41,952 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/23bf6ab6abb449268f340f999b347d12 2023-03-11 00:55:41,952 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/7bea231ed15941469cd0a779e46dee26 2023-03-11 00:55:41,965 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311326f4f83bd4a4dfa9462153e62e030b2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230311326f4f83bd4a4dfa9462153e62e030b2 2023-03-11 00:55:41,966 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311b695e2cc92ac4affa19edf5d019b6a74 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230311b695e2cc92ac4affa19edf5d019b6a74 2023-03-11 00:55:41,967 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303112192e0b499bf4d5ca6cb936d6d9bc715 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303112192e0b499bf4d5ca6cb936d6d9bc715 2023-03-11 00:55:42,378 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/08a1b9031f054a5085ae75d0be9dad3e 2023-03-11 00:55:42,378 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/5715d664dbd1454ba2eea1a18b1861dc 2023-03-11 00:55:42,380 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/eb282e5cb0d14998960e811d1389a5fb 2023-03-11 00:55:42,383 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/7bea231ed15941469cd0a779e46dee26 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/7bea231ed15941469cd0a779e46dee26 2023-03-11 00:55:42,383 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/23bf6ab6abb449268f340f999b347d12 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/23bf6ab6abb449268f340f999b347d12 2023-03-11 00:55:42,384 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/1c4104787c734652a3aec350d3a9f812 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/1c4104787c734652a3aec350d3a9f812 2023-03-11 00:55:42,386 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/7bea231ed15941469cd0a779e46dee26, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 00:55:42,387 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/23bf6ab6abb449268f340f999b347d12, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 00:55:42,387 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/1c4104787c734652a3aec350d3a9f812, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 00:55:42,387 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/5715d664dbd1454ba2eea1a18b1861dc as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/5715d664dbd1454ba2eea1a18b1861dc 2023-03-11 00:55:42,388 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/08a1b9031f054a5085ae75d0be9dad3e as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/08a1b9031f054a5085ae75d0be9dad3e 2023-03-11 00:55:42,388 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/eb282e5cb0d14998960e811d1389a5fb as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/eb282e5cb0d14998960e811d1389a5fb 2023-03-11 00:55:42,394 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/5715d664dbd1454ba2eea1a18b1861dc, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 00:55:42,394 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/08a1b9031f054a5085ae75d0be9dad3e, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 00:55:42,395 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/eb282e5cb0d14998960e811d1389a5fb, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 00:55:42,395 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d4d84b511dc532e521aa954b19da2872 in 1268ms, sequenceid=5, compaction requested=false 2023-03-11 00:55:42,395 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1e8871741be4163356575157eead69a3 in 1268ms, sequenceid=5, compaction requested=false 2023-03-11 00:55:42,395 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-11 00:55:42,395 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-11 00:55:42,396 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 439fc7d2553cd76c08e8dd28cd3ba7b6 in 1269ms, sequenceid=5, compaction requested=false 2023-03-11 00:55:42,396 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-11 00:55:42,396 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:55:42,397 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:55:42,397 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:42,397 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:55:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:55:42,397 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:42,397 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:55:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:55:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:55:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-11 00:55:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-11 00:55:42,400 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:42,400 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:42,401 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:42,401 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:42,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-11 00:55:42,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cd490c3[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:42,402 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-11 00:55:42,402 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:42,403 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:42,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:42,403 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-11 00:55:42,403 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-11 00:55:42,403 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:42,403 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,404 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:42,405 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-11 00:55:42,405 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,405 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:42,405 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-11 00:55:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:42,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-11 00:55:42,407 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-11 00:55:42,407 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:42,407 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:42,407 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-11 00:55:42,407 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:42,409 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:42,409 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:42,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:42,409 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:42,409 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:42,410 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:42,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:42,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,413 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,413 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:42,413 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:42,414 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,414 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:42,414 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:42,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-11 00:55:42,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:42,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-11 00:55:42,414 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:42,414 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:42,414 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:42,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:42,414 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:42,414 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:42,414 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:42,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:42,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:42,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:42,514 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:42,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:42,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:42,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:42,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:42,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:42,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:42,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-11 00:55:42,521 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-11 00:55:42,521 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:42,521 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-11 00:55:42,521 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-11 00:55:42,522 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:42,522 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:42,523 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,523 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:42,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:42,523 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:42,523 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:42,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:42,524 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-11 00:55:42,524 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-11 00:55:42,524 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-11 00:55:42,524 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-11 00:55:42,524 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:42,524 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-11 00:55:42,525 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:42,525 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. started... 2023-03-11 00:55:42,525 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:55:42,525 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:42,525 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:42,525 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. started... 2023-03-11 00:55:42,525 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d4d84b511dc532e521aa954b19da2872 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 00:55:42,525 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:42,525 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1e8871741be4163356575157eead69a3 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 00:55:42,525 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. started... 2023-03-11 00:55:42,525 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 439fc7d2553cd76c08e8dd28cd3ba7b6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 00:55:42,946 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311d29f9e27cbcc484895dcec51e0f9142e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230311d29f9e27cbcc484895dcec51e0f9142e 2023-03-11 00:55:42,946 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311b28500470f6242cb96d3a3bd9dfc848a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230311b28500470f6242cb96d3a3bd9dfc848a 2023-03-11 00:55:42,946 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311609a1c2e19a3466c8b54390a960fe37f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230311609a1c2e19a3466c8b54390a960fe37f 2023-03-11 00:55:42,958 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/18f1cb1667284b2fb40dc546bcf80c54 2023-03-11 00:55:43,352 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/fe88402e2bac4798833011d7d3aa5599 2023-03-11 00:55:43,358 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/dcd06a3d0b44472e91bc2ef2f08a2543 2023-03-11 00:55:43,370 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303112680cfa658094d7da63736cd1ac0f3f1 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303112680cfa658094d7da63736cd1ac0f3f1 2023-03-11 00:55:43,765 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311550d8948e7b644e7a1a8269b45fd4d73 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230311550d8948e7b644e7a1a8269b45fd4d73 2023-03-11 00:55:43,771 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311219290784133447f93b7aa9dedb931c3 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230311219290784133447f93b7aa9dedb931c3 2023-03-11 00:55:43,775 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/3c0cc4ebd63e4e878ce3181cdd4ade8f 2023-03-11 00:55:43,775 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/7d617857aa2b46ca866a53d5aebe18b4 2023-03-11 00:55:43,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/18f1cb1667284b2fb40dc546bcf80c54 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/18f1cb1667284b2fb40dc546bcf80c54 2023-03-11 00:55:43,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/dcd06a3d0b44472e91bc2ef2f08a2543 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/dcd06a3d0b44472e91bc2ef2f08a2543 2023-03-11 00:55:43,782 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/dcd06a3d0b44472e91bc2ef2f08a2543, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 00:55:43,782 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/18f1cb1667284b2fb40dc546bcf80c54, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 00:55:43,783 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/7d617857aa2b46ca866a53d5aebe18b4 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/7d617857aa2b46ca866a53d5aebe18b4 2023-03-11 00:55:43,783 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/3c0cc4ebd63e4e878ce3181cdd4ade8f as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/3c0cc4ebd63e4e878ce3181cdd4ade8f 2023-03-11 00:55:43,786 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/3c0cc4ebd63e4e878ce3181cdd4ade8f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 00:55:43,786 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/7d617857aa2b46ca866a53d5aebe18b4, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 00:55:43,787 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 439fc7d2553cd76c08e8dd28cd3ba7b6 in 1262ms, sequenceid=9, compaction requested=false 2023-03-11 00:55:43,787 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1e8871741be4163356575157eead69a3 in 1262ms, sequenceid=9, compaction requested=false 2023-03-11 00:55:43,787 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:55:43,787 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:43,787 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:55:43,787 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:55:43,787 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:43,787 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:55:44,170 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/a7a24e75f5af4f68b66f5d9c381b7f95 2023-03-11 00:55:44,174 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/fe88402e2bac4798833011d7d3aa5599 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/fe88402e2bac4798833011d7d3aa5599 2023-03-11 00:55:44,177 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/fe88402e2bac4798833011d7d3aa5599, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 00:55:44,178 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/a7a24e75f5af4f68b66f5d9c381b7f95 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/a7a24e75f5af4f68b66f5d9c381b7f95 2023-03-11 00:55:44,181 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/a7a24e75f5af4f68b66f5d9c381b7f95, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 00:55:44,182 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d4d84b511dc532e521aa954b19da2872 in 1657ms, sequenceid=9, compaction requested=false 2023-03-11 00:55:44,182 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:55:44,182 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:44,182 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:55:44,182 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:55:44,182 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,182 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-11 00:55:44,182 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-11 00:55:44,183 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:44,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:44,184 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:44,184 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:44,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-11 00:55:44,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b463046[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:44,185 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-11 00:55:44,185 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:44,186 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:44,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:44,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:44,186 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-11 00:55:44,186 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-11 00:55:44,186 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:44,186 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,186 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:44,191 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,191 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-11 00:55:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:44,191 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:44,191 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-11 00:55:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:44,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-11 00:55:44,193 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-11 00:55:44,193 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:44,193 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:44,193 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-11 00:55:44,193 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:44,195 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:44,195 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:44,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:44,195 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:44,195 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:44,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:44,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:44,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:44,196 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:44,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:44,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:44,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,198 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,198 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:44,198 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:44,198 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:44,198 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:44,198 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,198 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:44,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:44,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-11 00:55:44,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:44,198 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:44,198 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:44,198 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:44,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:44,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-11 00:55:44,199 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:44,199 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:44,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:44,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:44,299 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:44,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:44,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:44,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:44,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:44,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:44,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:44,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-11 00:55:44,305 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-11 00:55:44,305 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:44,305 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-11 00:55:44,305 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-11 00:55:44,305 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:44,305 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:44,308 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:44,308 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:44,308 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:44,308 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:44,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:44,309 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-11 00:55:44,309 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-11 00:55:44,309 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-11 00:55:44,309 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-11 00:55:44,309 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:44,309 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-11 00:55:44,310 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:44,310 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. started... 2023-03-11 00:55:44,310 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:55:44,310 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:44,310 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d4d84b511dc532e521aa954b19da2872 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 00:55:44,310 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. started... 2023-03-11 00:55:44,310 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:44,310 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:44,310 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 439fc7d2553cd76c08e8dd28cd3ba7b6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 00:55:44,310 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. started... 2023-03-11 00:55:44,310 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1e8871741be4163356575157eead69a3 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 00:55:44,329 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311e09b529750e6459285d1409d90c9c609 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230311e09b529750e6459285d1409d90c9c609 2023-03-11 00:55:44,722 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303119d7b7317d4674807b6a9dcecc70301d2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303119d7b7317d4674807b6a9dcecc70301d2 2023-03-11 00:55:44,725 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311c6482898dc5c4406af5457bc65af50e5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230311c6482898dc5c4406af5457bc65af50e5 2023-03-11 00:55:44,738 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/b70e2d932a2043cbb01c2e5b1ae3599a 2023-03-11 00:55:45,130 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/8767c4698e53457da40e8d88f82f41be 2023-03-11 00:55:45,131 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/7a2f7692ff5a420790c1549853fb68d5 2023-03-11 00:55:45,152 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311b61d9e0368e74a1a9b11d123569856c9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230311b61d9e0368e74a1a9b11d123569856c9 2023-03-11 00:55:45,550 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311ad63fa1d88c943ada60fcf00a35adae8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230311ad63fa1d88c943ada60fcf00a35adae8 2023-03-11 00:55:45,550 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031182c54cc51b734da0b35c9ab020de3b6b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023031182c54cc51b734da0b35c9ab020de3b6b 2023-03-11 00:55:45,562 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/6bce8de7f9f745fa9bc91dc72848cbe1 2023-03-11 00:55:45,566 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/b70e2d932a2043cbb01c2e5b1ae3599a as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/b70e2d932a2043cbb01c2e5b1ae3599a 2023-03-11 00:55:45,569 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/b70e2d932a2043cbb01c2e5b1ae3599a, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 00:55:45,569 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/6bce8de7f9f745fa9bc91dc72848cbe1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/6bce8de7f9f745fa9bc91dc72848cbe1 2023-03-11 00:55:45,572 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/6bce8de7f9f745fa9bc91dc72848cbe1, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 00:55:45,573 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 439fc7d2553cd76c08e8dd28cd3ba7b6 in 1263ms, sequenceid=13, compaction requested=true 2023-03-11 00:55:45,573 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:55:45,573 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:55:45,648 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:55:45,954 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/d5ff0dd9d8614911a05103a62b0ad4bb 2023-03-11 00:55:45,954 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/221768a1b49a413fb5eb1499c625cbf4 2023-03-11 00:55:45,958 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/7a2f7692ff5a420790c1549853fb68d5 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/7a2f7692ff5a420790c1549853fb68d5 2023-03-11 00:55:45,959 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/8767c4698e53457da40e8d88f82f41be as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/8767c4698e53457da40e8d88f82f41be 2023-03-11 00:55:45,962 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/7a2f7692ff5a420790c1549853fb68d5, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 00:55:45,962 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/8767c4698e53457da40e8d88f82f41be, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 00:55:45,962 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/d5ff0dd9d8614911a05103a62b0ad4bb as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/d5ff0dd9d8614911a05103a62b0ad4bb 2023-03-11 00:55:45,963 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/221768a1b49a413fb5eb1499c625cbf4 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/221768a1b49a413fb5eb1499c625cbf4 2023-03-11 00:55:45,966 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/d5ff0dd9d8614911a05103a62b0ad4bb, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 00:55:45,967 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/221768a1b49a413fb5eb1499c625cbf4, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 00:55:45,967 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1e8871741be4163356575157eead69a3 in 1657ms, sequenceid=13, compaction requested=true 2023-03-11 00:55:45,967 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:55:45,967 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:45,967 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:55:45,967 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d4d84b511dc532e521aa954b19da2872 in 1657ms, sequenceid=13, compaction requested=true 2023-03-11 00:55:45,967 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:55:45,967 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:45,967 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:55:45,968 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:55:45,968 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,968 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-11 00:55:45,968 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-11 00:55:45,969 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,969 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:45,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:45,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:45,969 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:45,969 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:45,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:45,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-11 00:55:45,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@470288cd[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:45,970 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-11 00:55:45,971 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:45,971 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:45,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:45,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:45,972 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-11 00:55:45,972 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-11 00:55:45,972 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,972 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:45,972 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:45,973 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,973 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-11 00:55:45,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:45,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:45,973 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:45,973 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-11 00:55:45,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:45,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:45,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-11 00:55:45,975 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-11 00:55:45,975 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:45,975 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:45,975 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-11 00:55:45,975 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:45,977 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:45,977 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:45,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:45,977 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:45,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:45,978 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:45,979 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,981 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,981 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:45,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-11 00:55:45,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:45,981 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:45,981 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:45,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:45,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:45,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-11 00:55:45,981 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:45,981 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:45,981 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:45,981 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:45,981 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:45,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:45,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:45,981 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:45,982 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:45,982 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:46,082 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:46,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:46,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:46,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:46,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:55:46,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:46,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:46,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-11 00:55:46,088 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-11 00:55:46,088 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:46,088 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-11 00:55:46,088 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-11 00:55:46,089 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:46,089 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:46,090 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:46,090 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:46,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:46,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:46,090 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:46,090 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:46,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:46,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:46,091 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-11 00:55:46,091 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-11 00:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-11 00:55:46,091 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-11 00:55:46,091 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:46,091 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-11 00:55:46,092 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:46,092 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. started... 2023-03-11 00:55:46,092 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:46,092 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:55:46,092 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:46,092 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d4d84b511dc532e521aa954b19da2872 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 00:55:46,092 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. started... 2023-03-11 00:55:46,092 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:46,092 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. started... 2023-03-11 00:55:46,092 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 439fc7d2553cd76c08e8dd28cd3ba7b6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 00:55:46,092 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1e8871741be4163356575157eead69a3 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 00:55:46,105 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303117b032470973e48f5aec1f256a5112a9b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303117b032470973e48f5aec1f256a5112a9b 2023-03-11 00:55:46,106 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311e78516b54afc4bb6a3a1c6b9b1376d51 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230311e78516b54afc4bb6a3a1c6b9b1376d51 2023-03-11 00:55:46,506 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303119ca9f5a043df440395552731ddaad310 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303119ca9f5a043df440395552731ddaad310 2023-03-11 00:55:46,511 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/3cc00161ca394bfb9c3f2b22926389a2 2023-03-11 00:55:46,511 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/e0c08ece3e1941988d0e1f0b8e39229c 2023-03-11 00:55:46,911 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/0cd5a69f9f75462694d3a4ee0dd818da 2023-03-11 00:55:46,923 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031114a834c86f964f51a5886313c7187420 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023031114a834c86f964f51a5886313c7187420 2023-03-11 00:55:46,924 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303113b7f82a6a1fc4b63abb3bfa4c204a046 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303113b7f82a6a1fc4b63abb3bfa4c204a046 2023-03-11 00:55:47,326 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031168e793942a874064b8a59f56509c0864 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023031168e793942a874064b8a59f56509c0864 2023-03-11 00:55:47,328 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/fe28d7213ee64be7824d16969f1e7e77 2023-03-11 00:55:47,329 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/4bd24338b114405bbdb7dbf37f9c9320 2023-03-11 00:55:47,332 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/3cc00161ca394bfb9c3f2b22926389a2 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/3cc00161ca394bfb9c3f2b22926389a2 2023-03-11 00:55:47,333 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/e0c08ece3e1941988d0e1f0b8e39229c as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/e0c08ece3e1941988d0e1f0b8e39229c 2023-03-11 00:55:47,335 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/3cc00161ca394bfb9c3f2b22926389a2, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 00:55:47,336 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/fe28d7213ee64be7824d16969f1e7e77 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/fe28d7213ee64be7824d16969f1e7e77 2023-03-11 00:55:47,336 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/e0c08ece3e1941988d0e1f0b8e39229c, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 00:55:47,337 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/4bd24338b114405bbdb7dbf37f9c9320 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/4bd24338b114405bbdb7dbf37f9c9320 2023-03-11 00:55:47,339 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/fe28d7213ee64be7824d16969f1e7e77, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 00:55:47,340 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 439fc7d2553cd76c08e8dd28cd3ba7b6 in 1248ms, sequenceid=17, compaction requested=true 2023-03-11 00:55:47,340 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:55:47,340 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:47,340 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:55:47,340 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/4bd24338b114405bbdb7dbf37f9c9320, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 00:55:47,341 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1e8871741be4163356575157eead69a3 in 1249ms, sequenceid=17, compaction requested=true 2023-03-11 00:55:47,341 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:55:47,341 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:47,341 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:55:47,731 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/bd5b5a4eb0374733bebcee16cc4e2a78 2023-03-11 00:55:47,735 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/0cd5a69f9f75462694d3a4ee0dd818da as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/0cd5a69f9f75462694d3a4ee0dd818da 2023-03-11 00:55:47,738 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/0cd5a69f9f75462694d3a4ee0dd818da, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 00:55:47,739 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/bd5b5a4eb0374733bebcee16cc4e2a78 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/bd5b5a4eb0374733bebcee16cc4e2a78 2023-03-11 00:55:47,742 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/bd5b5a4eb0374733bebcee16cc4e2a78, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 00:55:47,742 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d4d84b511dc532e521aa954b19da2872 in 1650ms, sequenceid=17, compaction requested=true 2023-03-11 00:55:47,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:55:47,742 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:47,743 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:55:47,743 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:55:47,743 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,743 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-11 00:55:47,743 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-11 00:55:47,744 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,744 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:47,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:47,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:47,744 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:47,745 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:47,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:47,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:47,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:47,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:47,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-11 00:55:47,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53c5c8fd[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:47,746 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-11 00:55:47,746 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:47,748 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:47,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:47,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:47,748 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-11 00:55:47,748 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-11 00:55:47,748 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,748 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:47,748 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:47,749 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-11 00:55:47,749 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,749 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:47,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:47,749 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-11 00:55:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:47,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-11 00:55:47,752 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-11 00:55:47,752 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:47,752 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:47,752 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-11 00:55:47,752 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:47,753 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:47,753 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:47,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:47,753 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:47,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:47,753 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:47,754 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,756 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,756 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:47,757 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:47,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:47,757 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:47,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-11 00:55:47,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:47,757 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:47,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-11 00:55:47,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:47,757 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:47,757 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:47,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:47,757 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:47,757 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:47,757 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:47,757 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:47,757 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:47,857 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:47,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:47,870 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:47,879 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:47,888 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:47,889 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:47,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:47,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:47,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-11 00:55:47,916 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-11 00:55:47,916 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:47,916 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-11 00:55:47,916 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-11 00:55:47,916 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:47,916 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:47,918 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:47,918 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:47,918 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:47,918 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:47,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:47,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:47,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:47,919 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-11 00:55:47,919 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-11 00:55:47,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-11 00:55:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-11 00:55:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-11 00:55:47,920 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:47,920 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. started... 2023-03-11 00:55:47,920 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:47,920 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. started... 2023-03-11 00:55:47,920 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:55:47,920 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:47,920 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 439fc7d2553cd76c08e8dd28cd3ba7b6 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 00:55:47,920 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:47,920 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d4d84b511dc532e521aa954b19da2872 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 00:55:47,920 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. started... 2023-03-11 00:55:47,920 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1e8871741be4163356575157eead69a3 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 00:55:48,740 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/78261fe8f14944a6a31bbc05dac484e7 2023-03-11 00:55:48,740 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/e91fb32fc0694ff5988efd73c0af34df 2023-03-11 00:55:48,740 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/10aca2c6a2874471b46dd8663e71aab8 2023-03-11 00:55:48,743 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78261fe8f14944a6a31bbc05dac484e7 2023-03-11 00:55:48,744 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e91fb32fc0694ff5988efd73c0af34df 2023-03-11 00:55:48,744 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10aca2c6a2874471b46dd8663e71aab8 2023-03-11 00:55:49,166 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/a4df17312faf413285d06f9b51b31e5f 2023-03-11 00:55:49,169 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4df17312faf413285d06f9b51b31e5f 2023-03-11 00:55:49,169 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/e91fb32fc0694ff5988efd73c0af34df as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/e91fb32fc0694ff5988efd73c0af34df 2023-03-11 00:55:49,173 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e91fb32fc0694ff5988efd73c0af34df 2023-03-11 00:55:49,173 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/e91fb32fc0694ff5988efd73c0af34df, entries=3, sequenceid=23, filesize=5.0 K 2023-03-11 00:55:49,173 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/a4df17312faf413285d06f9b51b31e5f as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/a4df17312faf413285d06f9b51b31e5f 2023-03-11 00:55:49,176 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4df17312faf413285d06f9b51b31e5f 2023-03-11 00:55:49,176 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/a4df17312faf413285d06f9b51b31e5f, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 00:55:49,177 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 439fc7d2553cd76c08e8dd28cd3ba7b6 in 1257ms, sequenceid=23, compaction requested=true 2023-03-11 00:55:49,177 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:55:49,177 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:49,177 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:55:49,563 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/f65c458707874707809c6d9b721ceed1 2023-03-11 00:55:49,563 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/b8505c9240424f57b7ec8d8bf7303095 2023-03-11 00:55:49,566 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f65c458707874707809c6d9b721ceed1 2023-03-11 00:55:49,566 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8505c9240424f57b7ec8d8bf7303095 2023-03-11 00:55:49,567 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/10aca2c6a2874471b46dd8663e71aab8 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/10aca2c6a2874471b46dd8663e71aab8 2023-03-11 00:55:49,567 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/78261fe8f14944a6a31bbc05dac484e7 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/78261fe8f14944a6a31bbc05dac484e7 2023-03-11 00:55:49,570 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10aca2c6a2874471b46dd8663e71aab8 2023-03-11 00:55:49,570 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/10aca2c6a2874471b46dd8663e71aab8, entries=3, sequenceid=23, filesize=5.0 K 2023-03-11 00:55:49,570 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78261fe8f14944a6a31bbc05dac484e7 2023-03-11 00:55:49,570 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/78261fe8f14944a6a31bbc05dac484e7, entries=3, sequenceid=23, filesize=5.0 K 2023-03-11 00:55:49,571 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/f65c458707874707809c6d9b721ceed1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/f65c458707874707809c6d9b721ceed1 2023-03-11 00:55:49,571 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/b8505c9240424f57b7ec8d8bf7303095 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/b8505c9240424f57b7ec8d8bf7303095 2023-03-11 00:55:49,575 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f65c458707874707809c6d9b721ceed1 2023-03-11 00:55:49,575 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8505c9240424f57b7ec8d8bf7303095 2023-03-11 00:55:49,575 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/f65c458707874707809c6d9b721ceed1, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 00:55:49,575 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/b8505c9240424f57b7ec8d8bf7303095, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 00:55:49,576 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1e8871741be4163356575157eead69a3 in 1656ms, sequenceid=23, compaction requested=true 2023-03-11 00:55:49,576 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d4d84b511dc532e521aa954b19da2872 in 1656ms, sequenceid=23, compaction requested=true 2023-03-11 00:55:49,576 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:55:49,576 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:49,576 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:55:49,576 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:49,576 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:55:49,576 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:55:49,576 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:55:49,576 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,576 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-11 00:55:49,576 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-11 00:55:49,578 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,578 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:49,578 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:49,578 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:49,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:49,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:49,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-11 00:55:49,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bdf18ce[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:49,580 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-11 00:55:49,580 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:49,581 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:49,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:49,581 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-11 00:55:49,581 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-11 00:55:49,581 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:49,581 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,581 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:49,582 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-11 00:55:49,582 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:49,582 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,582 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-11 00:55:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:49,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:49,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:49,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:49,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:49,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:49,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:49,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-11 00:55:49,585 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-11 00:55:49,585 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:49,585 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:49,585 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-11 00:55:49,585 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:49,593 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:49,593 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:49,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:49,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:49,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:49,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:49,593 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:49,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:49,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:49,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:49,594 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:49,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:49,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:49,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:49,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:49,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,595 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:49,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 00:55:49,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,597 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,597 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:49,597 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:49,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:49,597 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:49,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:49,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-11 00:55:49,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:49,597 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 00:55:49,597 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:49,597 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:49,597 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:49,597 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 00:55:49,597 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 00:55:49,597 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:49,598 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:49,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:49,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:49,698 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:49,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:49,699 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:49,699 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): d4d84b511dc532e521aa954b19da2872/family1 is initiating major compaction (all files) 2023-03-11 00:55:49,699 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:49,699 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:49,699 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of d4d84b511dc532e521aa954b19da2872/family1 in ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:49,700 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/7bea231ed15941469cd0a779e46dee26, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/fe88402e2bac4798833011d7d3aa5599, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/8767c4698e53457da40e8d88f82f41be, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/0cd5a69f9f75462694d3a4ee0dd818da, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/10aca2c6a2874471b46dd8663e71aab8] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp, totalSize=26.6 K 2023-03-11 00:55:49,700 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 7bea231ed15941469cd0a779e46dee26, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496141118 2023-03-11 00:55:49,701 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting fe88402e2bac4798833011d7d3aa5599, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496142517 2023-03-11 00:55:49,701 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 8767c4698e53457da40e8d88f82f41be, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496144301 2023-03-11 00:55:49,701 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 0cd5a69f9f75462694d3a4ee0dd818da, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496146084 2023-03-11 00:55:49,702 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 10aca2c6a2874471b46dd8663e71aab8, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:55:49,711 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): d4d84b511dc532e521aa954b19da2872#family1#compaction#148 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:50,119 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303112e4e9245e67c40eda47e743551e070a1_del 2023-03-11 00:55:50,119 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303112e4e9245e67c40eda47e743551e070a1_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303112e4e9245e67c40eda47e743551e070a1_del 2023-03-11 00:55:50,931 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c4aef21260c4c08befc8e27ad49cbbc 2023-03-11 00:55:50,932 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family1/1c4aef21260c4c08befc8e27ad49cbbc as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/1c4aef21260c4c08befc8e27ad49cbbc 2023-03-11 00:55:50,935 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c4aef21260c4c08befc8e27ad49cbbc 2023-03-11 00:55:50,936 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d4d84b511dc532e521aa954b19da2872/family1 of d4d84b511dc532e521aa954b19da2872 into 1c4aef21260c4c08befc8e27ad49cbbc(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:50,936 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:55:50,936 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:50,936 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): d4d84b511dc532e521aa954b19da2872/family2 is initiating major compaction (all files) 2023-03-11 00:55:50,936 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:50,936 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:50,937 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of d4d84b511dc532e521aa954b19da2872/family2 in ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:55:50,937 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/5715d664dbd1454ba2eea1a18b1861dc, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/a7a24e75f5af4f68b66f5d9c381b7f95, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/221768a1b49a413fb5eb1499c625cbf4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/bd5b5a4eb0374733bebcee16cc4e2a78, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/f65c458707874707809c6d9b721ceed1] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp, totalSize=25.3 K 2023-03-11 00:55:50,937 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 5715d664dbd1454ba2eea1a18b1861dc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496141118 2023-03-11 00:55:50,938 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting a7a24e75f5af4f68b66f5d9c381b7f95, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496142517 2023-03-11 00:55:50,938 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 221768a1b49a413fb5eb1499c625cbf4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496144301 2023-03-11 00:55:50,938 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting bd5b5a4eb0374733bebcee16cc4e2a78, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496146084 2023-03-11 00:55:50,939 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting f65c458707874707809c6d9b721ceed1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:55:50,945 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): d4d84b511dc532e521aa954b19da2872#family2#compaction#149 average throughput is 1.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:50,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/7bea231ed15941469cd0a779e46dee26, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/fe88402e2bac4798833011d7d3aa5599, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/8767c4698e53457da40e8d88f82f41be, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/0cd5a69f9f75462694d3a4ee0dd818da, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/10aca2c6a2874471b46dd8663e71aab8] to archive 2023-03-11 00:55:50,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:50,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/7bea231ed15941469cd0a779e46dee26 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/7bea231ed15941469cd0a779e46dee26 2023-03-11 00:55:50,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/fe88402e2bac4798833011d7d3aa5599 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/fe88402e2bac4798833011d7d3aa5599 2023-03-11 00:55:50,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/8767c4698e53457da40e8d88f82f41be to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/8767c4698e53457da40e8d88f82f41be 2023-03-11 00:55:50,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/0cd5a69f9f75462694d3a4ee0dd818da to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/0cd5a69f9f75462694d3a4ee0dd818da 2023-03-11 00:55:50,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/10aca2c6a2874471b46dd8663e71aab8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/10aca2c6a2874471b46dd8663e71aab8 2023-03-11 00:55:51,353 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303110d6199b38cdd4a61aaa334866b800c19_del 2023-03-11 00:55:51,353 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303110d6199b38cdd4a61aaa334866b800c19_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303110d6199b38cdd4a61aaa334866b800c19_del 2023-03-11 00:55:52,165 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78f648cc68d64477b198cbd59ec73e55 2023-03-11 00:55:52,166 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/.tmp/family2/78f648cc68d64477b198cbd59ec73e55 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/78f648cc68d64477b198cbd59ec73e55 2023-03-11 00:55:52,169 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78f648cc68d64477b198cbd59ec73e55 2023-03-11 00:55:52,170 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d4d84b511dc532e521aa954b19da2872/family2 of d4d84b511dc532e521aa954b19da2872 into 78f648cc68d64477b198cbd59ec73e55(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:52,170 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:55:52,170 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:52,170 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 439fc7d2553cd76c08e8dd28cd3ba7b6/family1 is initiating major compaction (all files) 2023-03-11 00:55:52,170 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:52,170 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:52,171 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 439fc7d2553cd76c08e8dd28cd3ba7b6/family1 in ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:52,171 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/1c4104787c734652a3aec350d3a9f812, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/18f1cb1667284b2fb40dc546bcf80c54, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/b70e2d932a2043cbb01c2e5b1ae3599a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/3cc00161ca394bfb9c3f2b22926389a2, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/e91fb32fc0694ff5988efd73c0af34df] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp, totalSize=26.6 K 2023-03-11 00:55:52,171 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 1c4104787c734652a3aec350d3a9f812, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496141118 2023-03-11 00:55:52,172 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 18f1cb1667284b2fb40dc546bcf80c54, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496142517 2023-03-11 00:55:52,172 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting b70e2d932a2043cbb01c2e5b1ae3599a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496144301 2023-03-11 00:55:52,172 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 3cc00161ca394bfb9c3f2b22926389a2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496146084 2023-03-11 00:55:52,172 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting e91fb32fc0694ff5988efd73c0af34df, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:55:52,180 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 439fc7d2553cd76c08e8dd28cd3ba7b6#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:52,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/5715d664dbd1454ba2eea1a18b1861dc, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/a7a24e75f5af4f68b66f5d9c381b7f95, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/221768a1b49a413fb5eb1499c625cbf4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/bd5b5a4eb0374733bebcee16cc4e2a78, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/f65c458707874707809c6d9b721ceed1] to archive 2023-03-11 00:55:52,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:52,186 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023031190720393c665497c95a4a73e5ce2b374_del 2023-03-11 00:55:52,186 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031190720393c665497c95a4a73e5ce2b374_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023031190720393c665497c95a4a73e5ce2b374_del 2023-03-11 00:55:52,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/5715d664dbd1454ba2eea1a18b1861dc to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/5715d664dbd1454ba2eea1a18b1861dc 2023-03-11 00:55:52,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/a7a24e75f5af4f68b66f5d9c381b7f95 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/a7a24e75f5af4f68b66f5d9c381b7f95 2023-03-11 00:55:52,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/221768a1b49a413fb5eb1499c625cbf4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/221768a1b49a413fb5eb1499c625cbf4 2023-03-11 00:55:52,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/bd5b5a4eb0374733bebcee16cc4e2a78 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/bd5b5a4eb0374733bebcee16cc4e2a78 2023-03-11 00:55:52,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/f65c458707874707809c6d9b721ceed1 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family2/f65c458707874707809c6d9b721ceed1 2023-03-11 00:55:52,614 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c05f9b7a3850443180c465d8783962cc 2023-03-11 00:55:52,615 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family1/c05f9b7a3850443180c465d8783962cc as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/c05f9b7a3850443180c465d8783962cc 2023-03-11 00:55:52,618 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c05f9b7a3850443180c465d8783962cc 2023-03-11 00:55:52,619 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 439fc7d2553cd76c08e8dd28cd3ba7b6/family1 of 439fc7d2553cd76c08e8dd28cd3ba7b6 into c05f9b7a3850443180c465d8783962cc(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:55:52,619 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:55:52,619 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:52,619 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 439fc7d2553cd76c08e8dd28cd3ba7b6/family2 is initiating major compaction (all files) 2023-03-11 00:55:52,619 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:52,620 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:52,620 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 439fc7d2553cd76c08e8dd28cd3ba7b6/family2 in ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:55:52,620 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/eb282e5cb0d14998960e811d1389a5fb, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/3c0cc4ebd63e4e878ce3181cdd4ade8f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/6bce8de7f9f745fa9bc91dc72848cbe1, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/fe28d7213ee64be7824d16969f1e7e77, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/a4df17312faf413285d06f9b51b31e5f] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp, totalSize=25.3 K 2023-03-11 00:55:52,621 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting eb282e5cb0d14998960e811d1389a5fb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496141118 2023-03-11 00:55:52,621 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 3c0cc4ebd63e4e878ce3181cdd4ade8f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496142517 2023-03-11 00:55:52,621 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 6bce8de7f9f745fa9bc91dc72848cbe1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496144301 2023-03-11 00:55:52,622 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting fe28d7213ee64be7824d16969f1e7e77, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496146084 2023-03-11 00:55:52,622 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting a4df17312faf413285d06f9b51b31e5f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:55:52,630 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 439fc7d2553cd76c08e8dd28cd3ba7b6#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:52,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/1c4104787c734652a3aec350d3a9f812, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/18f1cb1667284b2fb40dc546bcf80c54, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/b70e2d932a2043cbb01c2e5b1ae3599a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/3cc00161ca394bfb9c3f2b22926389a2, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/e91fb32fc0694ff5988efd73c0af34df] to archive 2023-03-11 00:55:52,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:52,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/1c4104787c734652a3aec350d3a9f812 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/1c4104787c734652a3aec350d3a9f812 2023-03-11 00:55:52,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/18f1cb1667284b2fb40dc546bcf80c54 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/18f1cb1667284b2fb40dc546bcf80c54 2023-03-11 00:55:52,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/b70e2d932a2043cbb01c2e5b1ae3599a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/b70e2d932a2043cbb01c2e5b1ae3599a 2023-03-11 00:55:52,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/3cc00161ca394bfb9c3f2b22926389a2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/3cc00161ca394bfb9c3f2b22926389a2 2023-03-11 00:55:52,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/e91fb32fc0694ff5988efd73c0af34df to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/e91fb32fc0694ff5988efd73c0af34df 2023-03-11 00:55:53,041 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023031157d04f5231c7476591349c066b8aa43f_del 2023-03-11 00:55:53,041 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031157d04f5231c7476591349c066b8aa43f_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023031157d04f5231c7476591349c066b8aa43f_del 2023-03-11 00:55:53,858 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f0829b43ffa4b7595d28754543331aa 2023-03-11 00:55:53,858 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/.tmp/family2/7f0829b43ffa4b7595d28754543331aa as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/7f0829b43ffa4b7595d28754543331aa 2023-03-11 00:55:53,862 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f0829b43ffa4b7595d28754543331aa 2023-03-11 00:55:53,862 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 439fc7d2553cd76c08e8dd28cd3ba7b6/family2 of 439fc7d2553cd76c08e8dd28cd3ba7b6 into 7f0829b43ffa4b7595d28754543331aa(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:53,862 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:55:53,863 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:53,863 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 1e8871741be4163356575157eead69a3/family1 is initiating major compaction (all files) 2023-03-11 00:55:53,863 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:53,863 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:53,863 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 1e8871741be4163356575157eead69a3/family1 in ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:53,863 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/23bf6ab6abb449268f340f999b347d12, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/dcd06a3d0b44472e91bc2ef2f08a2543, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/7a2f7692ff5a420790c1549853fb68d5, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/e0c08ece3e1941988d0e1f0b8e39229c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/78261fe8f14944a6a31bbc05dac484e7] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp, totalSize=26.6 K 2023-03-11 00:55:53,863 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 23bf6ab6abb449268f340f999b347d12, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496141118 2023-03-11 00:55:53,864 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting dcd06a3d0b44472e91bc2ef2f08a2543, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496142517 2023-03-11 00:55:53,864 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 7a2f7692ff5a420790c1549853fb68d5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496144301 2023-03-11 00:55:53,864 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting e0c08ece3e1941988d0e1f0b8e39229c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496146083 2023-03-11 00:55:53,865 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 78261fe8f14944a6a31bbc05dac484e7, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:55:53,873 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 1e8871741be4163356575157eead69a3#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:53,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/eb282e5cb0d14998960e811d1389a5fb, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/3c0cc4ebd63e4e878ce3181cdd4ade8f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/6bce8de7f9f745fa9bc91dc72848cbe1, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/fe28d7213ee64be7824d16969f1e7e77, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/a4df17312faf413285d06f9b51b31e5f] to archive 2023-03-11 00:55:53,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:53,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/eb282e5cb0d14998960e811d1389a5fb to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/eb282e5cb0d14998960e811d1389a5fb 2023-03-11 00:55:53,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/3c0cc4ebd63e4e878ce3181cdd4ade8f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/3c0cc4ebd63e4e878ce3181cdd4ade8f 2023-03-11 00:55:53,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/6bce8de7f9f745fa9bc91dc72848cbe1 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/6bce8de7f9f745fa9bc91dc72848cbe1 2023-03-11 00:55:53,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/fe28d7213ee64be7824d16969f1e7e77 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/fe28d7213ee64be7824d16969f1e7e77 2023-03-11 00:55:53,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/a4df17312faf413285d06f9b51b31e5f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family2/a4df17312faf413285d06f9b51b31e5f 2023-03-11 00:55:54,285 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023031109fb07f8716b44bda7213193bfcb1942_del 2023-03-11 00:55:54,285 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031109fb07f8716b44bda7213193bfcb1942_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023031109fb07f8716b44bda7213193bfcb1942_del 2023-03-11 00:55:55,099 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19820bbc550945f0b3a08e97de16ac05 2023-03-11 00:55:55,100 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family1/19820bbc550945f0b3a08e97de16ac05 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/19820bbc550945f0b3a08e97de16ac05 2023-03-11 00:55:55,103 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19820bbc550945f0b3a08e97de16ac05 2023-03-11 00:55:55,104 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1e8871741be4163356575157eead69a3/family1 of 1e8871741be4163356575157eead69a3 into 19820bbc550945f0b3a08e97de16ac05(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:55,104 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:55:55,104 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:55:55,104 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 1e8871741be4163356575157eead69a3/family2 is initiating major compaction (all files) 2023-03-11 00:55:55,104 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:55:55,104 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:55:55,105 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 1e8871741be4163356575157eead69a3/family2 in ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:55:55,105 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/08a1b9031f054a5085ae75d0be9dad3e, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/7d617857aa2b46ca866a53d5aebe18b4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/d5ff0dd9d8614911a05103a62b0ad4bb, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/4bd24338b114405bbdb7dbf37f9c9320, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/b8505c9240424f57b7ec8d8bf7303095] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp, totalSize=25.3 K 2023-03-11 00:55:55,105 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 08a1b9031f054a5085ae75d0be9dad3e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496141118 2023-03-11 00:55:55,105 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 7d617857aa2b46ca866a53d5aebe18b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496142517 2023-03-11 00:55:55,106 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting d5ff0dd9d8614911a05103a62b0ad4bb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496144301 2023-03-11 00:55:55,106 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 4bd24338b114405bbdb7dbf37f9c9320, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496146083 2023-03-11 00:55:55,106 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting b8505c9240424f57b7ec8d8bf7303095, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:55:55,114 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 1e8871741be4163356575157eead69a3#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:55:55,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/23bf6ab6abb449268f340f999b347d12, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/dcd06a3d0b44472e91bc2ef2f08a2543, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/7a2f7692ff5a420790c1549853fb68d5, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/e0c08ece3e1941988d0e1f0b8e39229c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/78261fe8f14944a6a31bbc05dac484e7] to archive 2023-03-11 00:55:55,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:55,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/23bf6ab6abb449268f340f999b347d12 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/23bf6ab6abb449268f340f999b347d12 2023-03-11 00:55:55,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/dcd06a3d0b44472e91bc2ef2f08a2543 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/dcd06a3d0b44472e91bc2ef2f08a2543 2023-03-11 00:55:55,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/7a2f7692ff5a420790c1549853fb68d5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/7a2f7692ff5a420790c1549853fb68d5 2023-03-11 00:55:55,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/e0c08ece3e1941988d0e1f0b8e39229c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/e0c08ece3e1941988d0e1f0b8e39229c 2023-03-11 00:55:55,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/78261fe8f14944a6a31bbc05dac484e7 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/78261fe8f14944a6a31bbc05dac484e7 2023-03-11 00:55:55,521 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230311e5bab5d607a244ef8485502fe3f199a0_del 2023-03-11 00:55:55,522 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311e5bab5d607a244ef8485502fe3f199a0_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230311e5bab5d607a244ef8485502fe3f199a0_del 2023-03-11 00:55:56,335 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 456e29e671fc43b498cb04de266d4f37 2023-03-11 00:55:56,336 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/.tmp/family2/456e29e671fc43b498cb04de266d4f37 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/456e29e671fc43b498cb04de266d4f37 2023-03-11 00:55:56,339 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 456e29e671fc43b498cb04de266d4f37 2023-03-11 00:55:56,340 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1e8871741be4163356575157eead69a3/family2 of 1e8871741be4163356575157eead69a3 into 456e29e671fc43b498cb04de266d4f37(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:55:56,340 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:55:56,343 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:56,346 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:56,349 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:56,349 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:56,354 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 00:55:56,365 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-11 00:55:56,367 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023031109fb07f8716b44bda7213193bfcb1942_del 2023-03-11 00:55:56,370 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023031190720393c665497c95a4a73e5ce2b374_del 2023-03-11 00:55:56,372 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303112e4e9245e67c40eda47e743551e070a1_del 2023-03-11 00:55:56,372 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-11 00:55:56,373 DEBUG [Listener at localhost/45619] zookeeper.ReadOnlyZKClient(139): Connect 0x0e421598 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:55:56,378 DEBUG [Listener at localhost/45619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3894c415, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:55:56,379 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 00:55:56,379 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 00:55:56,379 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 00:55:56,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/08a1b9031f054a5085ae75d0be9dad3e, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/7d617857aa2b46ca866a53d5aebe18b4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/d5ff0dd9d8614911a05103a62b0ad4bb, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/4bd24338b114405bbdb7dbf37f9c9320, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/b8505c9240424f57b7ec8d8bf7303095] to archive 2023-03-11 00:55:56,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:56,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/08a1b9031f054a5085ae75d0be9dad3e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/08a1b9031f054a5085ae75d0be9dad3e 2023-03-11 00:55:56,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/7d617857aa2b46ca866a53d5aebe18b4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/7d617857aa2b46ca866a53d5aebe18b4 2023-03-11 00:55:56,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/d5ff0dd9d8614911a05103a62b0ad4bb to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/d5ff0dd9d8614911a05103a62b0ad4bb 2023-03-11 00:55:56,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/4bd24338b114405bbdb7dbf37f9c9320 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/4bd24338b114405bbdb7dbf37f9c9320 2023-03-11 00:55:56,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/b8505c9240424f57b7ec8d8bf7303095 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family2/b8505c9240424f57b7ec8d8bf7303095 2023-03-11 00:55:56,407 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311dd0aabfd93b74be190a912c1476a9e06 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230311dd0aabfd93b74be190a912c1476a9e06 2023-03-11 00:55:56,407 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 00:55:56,421 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:55:56,424 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34564, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:55:56,430 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:55:56,433 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36212, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:55:56,445 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230311/family1/5b59c06876f946daa41cc7a58d9503ea first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-11 00:55:56,446 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230311/family1/5b59c06876f946daa41cc7a58d9503ea}] 2023-03-11 00:55:56,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230311/family1/5b59c06876f946daa41cc7a58d9503ea for inclusion in d4d84b511dc532e521aa954b19da2872/family1 2023-03-11 00:55:56,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-11 00:55:56,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-11 00:55:56,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:55:56,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230311/family1/5b59c06876f946daa41cc7a58d9503ea to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__1gcuhdkp7seg5p4l4q2fc43rttvnmr27f3oacfd13t7nl1g7buj87dgd320ql72v/family1/5b59c06876f946daa41cc7a58d9503ea 2023-03-11 00:55:56,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__1gcuhdkp7seg5p4l4q2fc43rttvnmr27f3oacfd13t7nl1g7buj87dgd320ql72v/family1/5b59c06876f946daa41cc7a58d9503ea as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/50d33335d40a445fb239ad5b892f58e0_SeqId_28_ 2023-03-11 00:55:56,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__1gcuhdkp7seg5p4l4q2fc43rttvnmr27f3oacfd13t7nl1g7buj87dgd320ql72v/family1/5b59c06876f946daa41cc7a58d9503ea into d4d84b511dc532e521aa954b19da2872/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/50d33335d40a445fb239ad5b892f58e0_SeqId_28_ - updating store file list. 2023-03-11 00:55:56,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/50d33335d40a445fb239ad5b892f58e0_SeqId_28_ into d4d84b511dc532e521aa954b19da2872/family1 2023-03-11 00:55:56,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__1gcuhdkp7seg5p4l4q2fc43rttvnmr27f3oacfd13t7nl1g7buj87dgd320ql72v/family1/5b59c06876f946daa41cc7a58d9503ea into d4d84b511dc532e521aa954b19da2872/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/family1/50d33335d40a445fb239ad5b892f58e0_SeqId_28_) 2023-03-11 00:55:56,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__1gcuhdkp7seg5p4l4q2fc43rttvnmr27f3oacfd13t7nl1g7buj87dgd320ql72v/family1/5b59c06876f946daa41cc7a58d9503ea 2023-03-11 00:55:56,462 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 00:55:56,463 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:56,464 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230311e0215851e2904a68acc203e0ff2068d6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230311e0215851e2904a68acc203e0ff2068d6 2023-03-11 00:55:56,464 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-11 00:55:56,464 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230311' 2023-03-11 00:55:56,464 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 00:55:56,807 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031185cca5f1afb1430c8a9e525778bd9898 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023031185cca5f1afb1430c8a9e525778bd9898 2023-03-11 00:55:56,807 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 00:55:56,833 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/family1/bfce0abb38cf46d584e59ce3e6db1d7d first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-11 00:55:56,833 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/family1/bfce0abb38cf46d584e59ce3e6db1d7d}] 2023-03-11 00:55:56,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/family1/bfce0abb38cf46d584e59ce3e6db1d7d for inclusion in 1e8871741be4163356575157eead69a3/family1 2023-03-11 00:55:56,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-11 00:55:56,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last=1 2023-03-11 00:55:56,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:55:56,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/family1/bfce0abb38cf46d584e59ce3e6db1d7d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__bmoem3o6lnpptvgkk693u7k3nth0nss46bu9iocjioe01cje3giu185vg0k138tu/family1/bfce0abb38cf46d584e59ce3e6db1d7d 2023-03-11 00:55:56,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__bmoem3o6lnpptvgkk693u7k3nth0nss46bu9iocjioe01cje3giu185vg0k138tu/family1/bfce0abb38cf46d584e59ce3e6db1d7d as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/4e1d512ccd974cefbf7712aab781db44_SeqId_28_ 2023-03-11 00:55:56,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__bmoem3o6lnpptvgkk693u7k3nth0nss46bu9iocjioe01cje3giu185vg0k138tu/family1/bfce0abb38cf46d584e59ce3e6db1d7d into 1e8871741be4163356575157eead69a3/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/4e1d512ccd974cefbf7712aab781db44_SeqId_28_ - updating store file list. 2023-03-11 00:55:56,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/4e1d512ccd974cefbf7712aab781db44_SeqId_28_ into 1e8871741be4163356575157eead69a3/family1 2023-03-11 00:55:56,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__bmoem3o6lnpptvgkk693u7k3nth0nss46bu9iocjioe01cje3giu185vg0k138tu/family1/bfce0abb38cf46d584e59ce3e6db1d7d into 1e8871741be4163356575157eead69a3/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/family1/4e1d512ccd974cefbf7712aab781db44_SeqId_28_) 2023-03-11 00:55:56,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__bmoem3o6lnpptvgkk693u7k3nth0nss46bu9iocjioe01cje3giu185vg0k138tu/family1/bfce0abb38cf46d584e59ce3e6db1d7d 2023-03-11 00:55:56,844 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 00:55:56,844 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:56,845 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303115fac4dcf56714dc5994d3b540a4bc573 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303115fac4dcf56714dc5994d3b540a4bc573 2023-03-11 00:55:56,845 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-11 00:55:56,845 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230311' 2023-03-11 00:55:56,845 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 00:55:57,203 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303119afd700a46f24c89a2a42d709efd7594 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303119afd700a46f24c89a2a42d709efd7594 2023-03-11 00:55:57,203 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 00:55:57,225 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230311/family1/2135f6ffe20240358fc165ad7ccd198d first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-11 00:55:57,226 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230311/family1/2135f6ffe20240358fc165ad7ccd198d}] 2023-03-11 00:55:57,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230311/family1/2135f6ffe20240358fc165ad7ccd198d for inclusion in 439fc7d2553cd76c08e8dd28cd3ba7b6/family1 2023-03-11 00:55:57,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-11 00:55:57,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-11 00:55:57,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:55:57,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230311/family1/2135f6ffe20240358fc165ad7ccd198d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__2nobki3358atq780sm8hkstje04s4t9ljpsnh08ms7vuirer94fvineuu4vdgb5l/family1/2135f6ffe20240358fc165ad7ccd198d 2023-03-11 00:55:57,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__2nobki3358atq780sm8hkstje04s4t9ljpsnh08ms7vuirer94fvineuu4vdgb5l/family1/2135f6ffe20240358fc165ad7ccd198d as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/73e84b9e24e349749411b5c6807fe478_SeqId_28_ 2023-03-11 00:55:57,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__2nobki3358atq780sm8hkstje04s4t9ljpsnh08ms7vuirer94fvineuu4vdgb5l/family1/2135f6ffe20240358fc165ad7ccd198d into 439fc7d2553cd76c08e8dd28cd3ba7b6/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/73e84b9e24e349749411b5c6807fe478_SeqId_28_ - updating store file list. 2023-03-11 00:55:57,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/73e84b9e24e349749411b5c6807fe478_SeqId_28_ into 439fc7d2553cd76c08e8dd28cd3ba7b6/family1 2023-03-11 00:55:57,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__2nobki3358atq780sm8hkstje04s4t9ljpsnh08ms7vuirer94fvineuu4vdgb5l/family1/2135f6ffe20240358fc165ad7ccd198d into 439fc7d2553cd76c08e8dd28cd3ba7b6/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/family1/73e84b9e24e349749411b5c6807fe478_SeqId_28_) 2023-03-11 00:55:57,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__ns_testMinorCompaction__2nobki3358atq780sm8hkstje04s4t9ljpsnh08ms7vuirer94fvineuu4vdgb5l/family1/2135f6ffe20240358fc165ad7ccd198d 2023-03-11 00:55:57,236 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 00:55:57,237 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:55:57,238 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230311248acb545fc445ad8e9a17632162cdf5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230311248acb545fc445ad8e9a17632162cdf5 2023-03-11 00:55:57,238 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-11 00:55:57,238 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230311' 2023-03-11 00:55:57,238 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 00:55:57,238 INFO [Listener at localhost/45619] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-11 00:55:57,241 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:57,242 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:57,245 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:55:57,246 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:55:57,263 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=255 (was 285), OpenFileDescriptor=644 (was 759), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=168 (was 150) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=5401 (was 5408) 2023-03-11 00:55:57,278 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=255, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=168, ProcessCount=170, AvailableMemoryMB=5401 2023-03-11 00:55:57,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-11 00:55:57,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:57,282 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:55:57,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-11 00:55:57,282 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:55:57,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 00:55:57,284 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663 2023-03-11 00:55:57,284 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663 empty. 2023-03-11 00:55:57,284 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663 2023-03-11 00:55:57,284 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-11 00:55:57,291 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-11 00:55:57,292 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => ed94f2cc321958ef391106e73bef4663, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:55:57,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 00:55:57,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 00:55:57,697 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:57,697 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing ed94f2cc321958ef391106e73bef4663, disabling compactions & flushes 2023-03-11 00:55:57,697 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:57,697 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:57,697 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. after waiting 0 ms 2023-03-11 00:55:57,697 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:57,697 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:57,697 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:55:57,699 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:55:57,700 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678496157700"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496157700"}]},"ts":"1678496157700"} 2023-03-11 00:55:57,701 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 00:55:57,702 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:55:57,702 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496157702"}]},"ts":"1678496157702"} 2023-03-11 00:55:57,703 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-11 00:55:57,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ed94f2cc321958ef391106e73bef4663, ASSIGN}] 2023-03-11 00:55:57,707 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ed94f2cc321958ef391106e73bef4663, ASSIGN 2023-03-11 00:55:57,707 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ed94f2cc321958ef391106e73bef4663, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:55:57,858 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=ed94f2cc321958ef391106e73bef4663, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:57,858 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678496157858"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496157858"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496157858"}]},"ts":"1678496157858"} 2023-03-11 00:55:57,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure ed94f2cc321958ef391106e73bef4663, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:55:57,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 00:55:58,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:58,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed94f2cc321958ef391106e73bef4663, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663.', STARTKEY => '', ENDKEY => ''} 2023-03-11 00:55:58,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy ed94f2cc321958ef391106e73bef4663 2023-03-11 00:55:58,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:55:58,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ed94f2cc321958ef391106e73bef4663 2023-03-11 00:55:58,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ed94f2cc321958ef391106e73bef4663 2023-03-11 00:55:58,015 INFO [StoreOpener-ed94f2cc321958ef391106e73bef4663-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ed94f2cc321958ef391106e73bef4663 2023-03-11 00:55:58,016 DEBUG [StoreOpener-ed94f2cc321958ef391106e73bef4663-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1 2023-03-11 00:55:58,016 DEBUG [StoreOpener-ed94f2cc321958ef391106e73bef4663-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1 2023-03-11 00:55:58,017 INFO [StoreOpener-ed94f2cc321958ef391106e73bef4663-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed94f2cc321958ef391106e73bef4663 columnFamilyName family1 2023-03-11 00:55:58,018 INFO [StoreOpener-ed94f2cc321958ef391106e73bef4663-1] regionserver.HStore(310): Store=ed94f2cc321958ef391106e73bef4663/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:55:58,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663 2023-03-11 00:55:58,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663 2023-03-11 00:55:58,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ed94f2cc321958ef391106e73bef4663 2023-03-11 00:55:58,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:55:58,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ed94f2cc321958ef391106e73bef4663; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62711531, jitterRate=-0.0655253678560257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 00:55:58,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:55:58,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663., pid=114, masterSystemTime=1678496158011 2023-03-11 00:55:58,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:58,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:58,025 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=ed94f2cc321958ef391106e73bef4663, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,025 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678496158025"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496158025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496158025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496158025"}]},"ts":"1678496158025"} 2023-03-11 00:55:58,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-11 00:55:58,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure ed94f2cc321958ef391106e73bef4663, server=jenkins-hbase4.apache.org,38819,1678496016129 in 166 msec 2023-03-11 00:55:58,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-11 00:55:58,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ed94f2cc321958ef391106e73bef4663, ASSIGN in 322 msec 2023-03-11 00:55:58,029 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:55:58,029 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496158029"}]},"ts":"1678496158029"} 2023-03-11 00:55:58,030 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-11 00:55:58,031 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:55:58,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 752 msec 2023-03-11 00:55:58,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 00:55:58,386 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-11 00:55:58,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:58,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,407 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:55:58,407 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:58,408 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:55:58,408 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:55:58,408 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,408 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,410 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,410 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:58,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:58,410 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,410 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,411 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,411 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:55:58,411 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:58,411 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:55:58,412 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:55:58,412 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:58,412 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:58,412 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. started... 2023-03-11 00:55:58,412 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ed94f2cc321958ef391106e73bef4663 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 00:55:58,434 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ce06a8f7eda34b51ade18952bad07209 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ce06a8f7eda34b51ade18952bad07209 2023-03-11 00:55:58,838 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/af5603bd56c741d2b4a952ce2eaabdbf 2023-03-11 00:55:58,843 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/af5603bd56c741d2b4a952ce2eaabdbf as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/af5603bd56c741d2b4a952ce2eaabdbf 2023-03-11 00:55:58,847 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/af5603bd56c741d2b4a952ce2eaabdbf, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-11 00:55:58,848 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ed94f2cc321958ef391106e73bef4663 in 436ms, sequenceid=5, compaction requested=false 2023-03-11 00:55:58,848 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:55:58,848 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:55:58,848 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:58,848 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:55:58,849 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:55:58,849 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,849 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:55:58,849 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:55:58,850 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,850 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:58,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:58,851 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,851 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:58,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:58,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:58,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:58,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:55:58,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6161dff3[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:58,852 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:55:58,852 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,853 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:55:58,853 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,853 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:58,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:55:58,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:58,855 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:55:58,855 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:58,855 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,855 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:55:58,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:58,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:58,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:58,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:58,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:58,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:58,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:55:58,857 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:55:58,857 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:58,857 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:58,857 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,857 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:58,860 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,860 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:58,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:58,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,860 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:58,860 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:58,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:58,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,861 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:58,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,863 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:58,863 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:58,863 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:58,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:58,863 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:55:58,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:58,864 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:58,864 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,864 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,864 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,864 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,864 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:58,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:58,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 00:55:58,864 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:58,864 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:58,964 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:58,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:58,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:58,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:58,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,971 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:55:58,971 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:58,971 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:55:58,971 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:55:58,972 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,972 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,973 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:58,973 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:58,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:58,974 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:58,974 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:58,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:58,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,974 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,975 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:55:58,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:58,975 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:55:58,975 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:58,975 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:55:58,975 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:55:58,975 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:58,975 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:58,975 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. started... 2023-03-11 00:55:58,975 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ed94f2cc321958ef391106e73bef4663 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 00:55:59,389 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280e10cc938a0a408e910ecbcf8760125e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511280e10cc938a0a408e910ecbcf8760125e 2023-03-11 00:55:59,394 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/e24bcd40b9084d1a928290411dbcfe4a 2023-03-11 00:55:59,397 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/e24bcd40b9084d1a928290411dbcfe4a as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/e24bcd40b9084d1a928290411dbcfe4a 2023-03-11 00:55:59,401 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/e24bcd40b9084d1a928290411dbcfe4a, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 00:55:59,401 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ed94f2cc321958ef391106e73bef4663 in 426ms, sequenceid=9, compaction requested=false 2023-03-11 00:55:59,402 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:55:59,402 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:59,402 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:55:59,402 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:55:59,402 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,402 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:55:59,402 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:55:59,404 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,404 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:59,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:59,404 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,404 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:59,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:59,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:59,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:55:59,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32f677f2[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:59,405 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:55:59,405 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,408 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,408 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:55:59,408 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:55:59,408 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:59,408 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,408 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:59,409 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:55:59,409 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:59,409 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,410 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:55:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:59,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:59,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:55:59,412 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:55:59,412 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:59,412 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:59,412 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,412 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:59,413 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,413 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,413 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:59,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:59,414 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:59,415 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,417 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,417 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:59,417 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:55:59,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:59,417 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,417 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:59,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:59,417 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:59,417 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:59,417 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:59,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:59,417 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 00:55:59,417 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,417 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,418 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:59,517 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:55:59,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:55:59,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:55:59,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:55:59,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,523 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:55:59,523 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:59,523 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:55:59,523 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:55:59,524 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,524 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,528 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:59,528 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:59,529 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,529 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:55:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:55:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,529 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,530 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:55:59,530 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,530 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:55:59,530 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:55:59,530 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:55:59,530 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:55:59,530 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:55:59,530 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:59,530 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. started... 2023-03-11 00:55:59,530 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ed94f2cc321958ef391106e73bef4663 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:55:59,541 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120103e50ffcd0854da5963c634d5f5a1241 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120103e50ffcd0854da5963c634d5f5a1241 2023-03-11 00:55:59,946 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/15aaa03fcc1e4473ac94962bc7ffc2a2 2023-03-11 00:55:59,949 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/15aaa03fcc1e4473ac94962bc7ffc2a2 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/15aaa03fcc1e4473ac94962bc7ffc2a2 2023-03-11 00:55:59,952 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/15aaa03fcc1e4473ac94962bc7ffc2a2, entries=1, sequenceid=13, filesize=4.9 K 2023-03-11 00:55:59,953 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ed94f2cc321958ef391106e73bef4663 in 423ms, sequenceid=13, compaction requested=true 2023-03-11 00:55:59,953 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:55:59,953 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:55:59,953 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:55:59,954 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:55:59,954 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,954 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:55:59,954 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:55:59,955 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,955 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:59,956 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,956 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:55:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:59,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:55:59,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f09c371[Count = 0] remaining members to acquire global barrier 2023-03-11 00:55:59,957 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:55:59,957 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,958 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,958 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:55:59,958 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:55:59,958 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,958 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:55:59,958 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:55:59,961 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,961 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:55:59,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:59,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:59,961 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:59,961 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:55:59,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:59,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:59,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:59,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:55:59,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:55:59,963 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:55:59,963 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:55:59,963 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:55:59,963 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,963 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:55:59,965 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,965 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,965 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:59,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:55:59,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:55:59,965 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:59,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:59,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:55:59,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:55:59,966 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:55:59,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,968 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,968 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:55:59,968 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,968 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:55:59,969 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:55:59,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:55:59,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:55:59,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:55:59,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 00:55:59,968 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:55:59,969 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:55:59,969 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:55:59,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:55:59,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:55:59,969 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,969 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:55:59,969 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:55:59,969 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,069 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:00,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:00,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:00,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:00,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,075 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:00,075 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:00,075 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:56:00,075 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:56:00,075 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,075 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,077 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,077 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:00,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:00,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:00,077 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,077 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:00,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:00,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:56:00,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,078 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:56:00,078 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:00,078 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:56:00,078 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:56:00,078 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:00,078 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:00,078 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. started... 2023-03-11 00:56:00,078 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ed94f2cc321958ef391106e73bef4663 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:56:00,489 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205272df7b05adc45b1a4a337b63dee9205 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205272df7b05adc45b1a4a337b63dee9205 2023-03-11 00:56:00,894 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/2f5ec4cbecc544949f50b3ed64763782 2023-03-11 00:56:00,898 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/2f5ec4cbecc544949f50b3ed64763782 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/2f5ec4cbecc544949f50b3ed64763782 2023-03-11 00:56:00,901 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/2f5ec4cbecc544949f50b3ed64763782, entries=1, sequenceid=17, filesize=4.9 K 2023-03-11 00:56:00,902 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ed94f2cc321958ef391106e73bef4663 in 824ms, sequenceid=17, compaction requested=true 2023-03-11 00:56:00,902 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:00,902 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:00,902 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:56:00,902 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:56:00,902 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,902 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:56:00,902 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:56:00,904 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,904 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:00,905 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,905 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:00,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:56:00,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cf3ab36[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:00,906 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:56:00,906 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,907 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,907 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:56:00,907 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,907 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:00,907 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:56:00,907 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:00,909 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:56:00,909 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,909 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:00,909 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:56:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:00,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:56:00,911 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:56:00,911 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:00,911 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:00,911 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,911 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:00,912 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,912 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:00,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,912 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:00,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:00,913 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,914 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:00,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 00:56:00,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:00,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:00,917 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:00,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:00,917 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:00,918 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:00,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:00,917 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:00,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:00,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:00,918 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,918 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:00,918 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,018 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:01,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:01,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:01,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:01,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,023 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:01,023 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:01,024 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:56:01,024 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:56:01,024 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,024 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,025 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,025 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:01,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:01,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:01,025 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,025 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:01,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:01,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,026 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,027 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:56:01,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,027 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:56:01,027 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:01,027 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:56:01,027 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:56:01,027 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:01,027 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:01,027 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. started... 2023-03-11 00:56:01,027 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ed94f2cc321958ef391106e73bef4663 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:56:01,438 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228921631697eb94a0cbd001609e5eee369 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228921631697eb94a0cbd001609e5eee369 2023-03-11 00:56:01,844 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/9c1130b3c6f94f4985ce5617db8360cf 2023-03-11 00:56:01,849 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/9c1130b3c6f94f4985ce5617db8360cf as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/9c1130b3c6f94f4985ce5617db8360cf 2023-03-11 00:56:01,852 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/9c1130b3c6f94f4985ce5617db8360cf, entries=1, sequenceid=21, filesize=4.9 K 2023-03-11 00:56:01,853 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ed94f2cc321958ef391106e73bef4663 in 826ms, sequenceid=21, compaction requested=true 2023-03-11 00:56:01,853 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:01,853 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:01,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:56:01,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:56:01,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:56:01,853 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:56:01,854 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,854 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:01,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:56:01,856 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:56:01,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4302771c[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:01,856 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,857 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,857 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:56:01,857 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:56:01,857 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,857 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:01,857 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:01,860 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:56:01,860 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:01,860 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,860 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:56:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:01,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:56:01,862 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:56:01,862 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:01,862 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:01,862 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,862 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:01,863 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,863 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:01,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,863 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:01,864 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,865 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:01,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:01,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:01,870 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:01,870 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:01,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:01,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:01,970 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:01,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:01,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:01,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:01,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,976 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:01,977 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:01,977 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:56:01,977 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:56:01,977 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,977 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,978 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,978 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:01,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:01,979 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:01,979 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,979 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,980 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:56:01,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:56:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:56:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:56:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:01,980 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:01,980 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. started... 2023-03-11 00:56:01,980 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ed94f2cc321958ef391106e73bef4663 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:56:02,391 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312227b845bc9d4e73a0dbab2606bec8a6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312227b845bc9d4e73a0dbab2606bec8a6 2023-03-11 00:56:02,796 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/eeaf270ae8df4a6bb6652f5f1af38c8e 2023-03-11 00:56:02,800 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/eeaf270ae8df4a6bb6652f5f1af38c8e as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/eeaf270ae8df4a6bb6652f5f1af38c8e 2023-03-11 00:56:02,804 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/eeaf270ae8df4a6bb6652f5f1af38c8e, entries=1, sequenceid=25, filesize=4.9 K 2023-03-11 00:56:02,805 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ed94f2cc321958ef391106e73bef4663 in 825ms, sequenceid=25, compaction requested=true 2023-03-11 00:56:02,805 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:02,805 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:02,805 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:56:02,805 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:56:02,805 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,805 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:56:02,805 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:56:02,806 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,806 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:02,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:02,807 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,807 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:02,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:02,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:02,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:02,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:56:02,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@424ad169[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:02,808 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:56:02,808 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,809 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,810 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:56:02,823 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:56:02,810 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,823 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:02,823 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:02,823 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:56:02,824 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ed89200 to 127.0.0.1:62412 2023-03-11 00:56:02,824 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:56:02,824 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:56:02,824 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:56:02,824 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:02,824 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28b43b23 to 127.0.0.1:62412 2023-03-11 00:56:02,824 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:56:02,824 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:56:02,825 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,825 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:56:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:02,825 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e421598 to 127.0.0.1:62412 2023-03-11 00:56:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:02,825 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:56:02,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:02,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:56:02,833 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:56:02,833 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:02,833 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:02,833 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,833 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:02,835 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,835 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,835 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:02,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:02,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:02,835 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,836 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,838 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,838 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,838 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,838 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,838 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:02,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:02,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:02,838 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:02,838 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:02,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:02,838 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,838 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:02,838 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,838 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:02,839 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:02,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:02,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:02,939 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:02,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:02,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:02,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:02,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,945 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:02,945 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:02,945 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:56:02,945 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:56:02,945 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,945 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,948 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,948 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:02,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:02,948 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:02,948 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,948 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,949 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:56:02,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:02,949 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:56:02,949 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:02,949 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:56:02,949 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:56:02,949 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:02,949 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:02,949 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. started... 2023-03-11 00:56:02,949 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ed94f2cc321958ef391106e73bef4663 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:56:03,359 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010171edace0575743b784efd3fe4c4f9c11 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010171edace0575743b784efd3fe4c4f9c11 2023-03-11 00:56:03,551 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:56:03,764 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/88c0f1c4e36f4e578d9fe6dc1ca495a3 2023-03-11 00:56:03,768 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/88c0f1c4e36f4e578d9fe6dc1ca495a3 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/88c0f1c4e36f4e578d9fe6dc1ca495a3 2023-03-11 00:56:03,771 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/88c0f1c4e36f4e578d9fe6dc1ca495a3, entries=1, sequenceid=29, filesize=4.9 K 2023-03-11 00:56:03,771 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ed94f2cc321958ef391106e73bef4663 in 822ms, sequenceid=29, compaction requested=true 2023-03-11 00:56:03,772 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:03,772 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:03,772 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:56:03,772 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:56:03,772 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,772 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:56:03,772 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:56:03,773 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,774 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:03,774 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,774 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:03,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:56:03,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43d9801a[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:03,775 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:56:03,775 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,776 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,776 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:56:03,776 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,776 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:03,776 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:56:03,776 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:03,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:56:03,778 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:03,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:56:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:03,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:03,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:03,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:56:03,780 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:56:03,780 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:03,780 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:03,780 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,780 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:03,782 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,782 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:03,782 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:03,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:03,783 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:03,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,784 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:03,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,786 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,786 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:03,786 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:03,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:03,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:03,786 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:03,786 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:03,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:03,786 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,787 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:03,787 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,787 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:03,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:03,787 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:03,787 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,787 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,887 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:03,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:03,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:03,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:03,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,893 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:03,893 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:03,893 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:56:03,893 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:56:03,893 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,893 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,894 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,895 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:03,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:03,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:03,895 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:03,895 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:03,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:03,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,896 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,896 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:56:03,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:03,896 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:56:03,896 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:03,896 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:56:03,896 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:56:03,896 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:03,896 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:03,896 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. started... 2023-03-11 00:56:03,897 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ed94f2cc321958ef391106e73bef4663 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:56:04,306 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033013410c1c6b43a78ade5657e5ff9800 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033013410c1c6b43a78ade5657e5ff9800 2023-03-11 00:56:04,311 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/3a4d1634e9b2415084485e9862fd0e4c 2023-03-11 00:56:04,314 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/3a4d1634e9b2415084485e9862fd0e4c as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/3a4d1634e9b2415084485e9862fd0e4c 2023-03-11 00:56:04,317 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/3a4d1634e9b2415084485e9862fd0e4c, entries=1, sequenceid=33, filesize=4.9 K 2023-03-11 00:56:04,318 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ed94f2cc321958ef391106e73bef4663 in 421ms, sequenceid=33, compaction requested=true 2023-03-11 00:56:04,318 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:04,318 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:56:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:56:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:56:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:56:04,320 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,320 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:04,320 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,320 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:04,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:56:04,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72c2294c[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:04,321 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:56:04,321 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,323 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,323 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:56:04,323 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,323 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:04,323 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:56:04,324 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:56:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:04,325 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:56:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:04,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:56:04,327 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:56:04,327 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:04,327 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:04,327 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,327 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:04,330 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,330 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:04,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,331 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:04,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:04,331 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,332 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,335 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:04,335 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:04,335 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:04,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:04,335 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:04,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:04,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:04,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 00:56:04,335 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:04,336 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:04,336 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,336 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:04,336 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:04,336 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,336 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,336 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,436 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:04,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:04,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:04,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:04,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,442 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:04,442 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:04,442 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:56:04,442 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:56:04,443 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,443 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,444 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,444 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:04,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:04,444 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:04,444 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:56:04,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:04,445 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:56:04,445 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:04,445 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:56:04,446 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:56:04,446 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:04,446 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:04,446 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. started... 2023-03-11 00:56:04,446 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ed94f2cc321958ef391106e73bef4663 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:56:04,857 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e88bb7b792ac42dda4d326a73fa231a7 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907e88bb7b792ac42dda4d326a73fa231a7 2023-03-11 00:56:05,262 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/0bc30e9f40dd486380a48ea493d1f032 2023-03-11 00:56:05,266 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/0bc30e9f40dd486380a48ea493d1f032 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/0bc30e9f40dd486380a48ea493d1f032 2023-03-11 00:56:05,269 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/0bc30e9f40dd486380a48ea493d1f032, entries=1, sequenceid=37, filesize=4.9 K 2023-03-11 00:56:05,270 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ed94f2cc321958ef391106e73bef4663 in 824ms, sequenceid=37, compaction requested=true 2023-03-11 00:56:05,270 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:05,270 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:56:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:56:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:56:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:56:05,272 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,272 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:05,272 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,272 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:05,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:56:05,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22280a9f[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:05,273 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:56:05,273 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,274 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,274 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:56:05,274 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:56:05,274 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:05,274 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,274 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:05,276 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:56:05,276 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,276 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,276 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:56:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:05,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:56:05,278 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:56:05,278 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:05,278 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:05,278 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,278 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:05,280 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,280 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:05,280 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,280 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:05,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,281 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,283 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:05,283 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:05,283 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:05,283 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:05,283 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:05,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:05,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:05,283 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:05,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:05,283 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,284 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,284 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,284 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,284 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:05,284 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:05,384 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:05,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:05,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:05,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:05,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,390 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:05,390 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:05,390 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 00:56:05,390 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 00:56:05,390 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,390 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,391 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:05,391 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:05,392 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:05,392 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,393 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,393 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 00:56:05,393 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:05,393 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 00:56:05,393 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:05,393 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 00:56:05,393 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 00:56:05,393 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:05,393 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:05,393 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. started... 2023-03-11 00:56:05,393 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ed94f2cc321958ef391106e73bef4663 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 00:56:05,805 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120bf0193a4f67e43819155c61ec311c605 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120bf0193a4f67e43819155c61ec311c605 2023-03-11 00:56:06,210 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/47704d80c09348d3997c4c7c7d2fc9b1 2023-03-11 00:56:06,214 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/47704d80c09348d3997c4c7c7d2fc9b1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/47704d80c09348d3997c4c7c7d2fc9b1 2023-03-11 00:56:06,216 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/47704d80c09348d3997c4c7c7d2fc9b1, entries=1, sequenceid=41, filesize=4.9 K 2023-03-11 00:56:06,217 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ed94f2cc321958ef391106e73bef4663 in 824ms, sequenceid=41, compaction requested=true 2023-03-11 00:56:06,217 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:06,217 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:06,217 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 00:56:06,217 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 00:56:06,217 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,217 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 00:56:06,217 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 00:56:06,220 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,220 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:06,221 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,221 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:06,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 00:56:06,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36fd562a[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:06,222 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 00:56:06,222 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,223 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,223 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 00:56:06,223 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,223 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:06,223 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 00:56:06,223 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:06,225 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,225 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 00:56:06,225 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:06,225 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:06,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 00:56:06,227 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 00:56:06,227 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:06,227 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:06,227 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,227 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:06,229 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,229 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,229 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:06,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:06,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:06,229 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,230 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,233 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,233 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:06,233 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:06,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:06,233 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,233 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:06,233 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:06,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 00:56:06,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:06,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:06,233 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:06,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:06,233 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,234 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,234 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,234 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:06,234 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:06,334 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:06,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:06,336 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-11 00:56:06,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:56:06,338 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:56:06,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:56:06,339 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496766339 2023-03-11 00:56:06,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 00:56:06,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-11 00:56:06,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:56:06,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x149e6bd6 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:56:06,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e9bfdac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:56:06,345 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:56:07,173 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010324f8b743888242eba4bc519bb99778d1 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010324f8b743888242eba4bc519bb99778d1 2023-03-11 00:56:07,174 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:56:07,186 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:56:07,188 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43992, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:56:07,193 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:56:07,194 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60864, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:56:07,204 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/45879291e97949c987b77a0002327fb5 first=Optional[r5] last=Optional[r6] 2023-03-11 00:56:07,205 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/45879291e97949c987b77a0002327fb5}] 2023-03-11 00:56:07,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/45879291e97949c987b77a0002327fb5 for inclusion in ed94f2cc321958ef391106e73bef4663/family1 2023-03-11 00:56:07,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-11 00:56:07,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:56:07,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:07,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/45879291e97949c987b77a0002327fb5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5f64fi4gvp407j83o5lbt8qm0cicv2ohqubfbr1a60bt4lae54tpgl5npp0d3ecm/family1/45879291e97949c987b77a0002327fb5 2023-03-11 00:56:07,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5f64fi4gvp407j83o5lbt8qm0cicv2ohqubfbr1a60bt4lae54tpgl5npp0d3ecm/family1/45879291e97949c987b77a0002327fb5 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/7646dfbe3d3148cdaeade45e519086b4_SeqId_44_ 2023-03-11 00:56:07,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5f64fi4gvp407j83o5lbt8qm0cicv2ohqubfbr1a60bt4lae54tpgl5npp0d3ecm/family1/45879291e97949c987b77a0002327fb5 into ed94f2cc321958ef391106e73bef4663/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/7646dfbe3d3148cdaeade45e519086b4_SeqId_44_ - updating store file list. 2023-03-11 00:56:07,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/7646dfbe3d3148cdaeade45e519086b4_SeqId_44_ into ed94f2cc321958ef391106e73bef4663/family1 2023-03-11 00:56:07,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5f64fi4gvp407j83o5lbt8qm0cicv2ohqubfbr1a60bt4lae54tpgl5npp0d3ecm/family1/45879291e97949c987b77a0002327fb5 into ed94f2cc321958ef391106e73bef4663/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/7646dfbe3d3148cdaeade45e519086b4_SeqId_44_) 2023-03-11 00:56:07,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5f64fi4gvp407j83o5lbt8qm0cicv2ohqubfbr1a60bt4lae54tpgl5npp0d3ecm/family1/45879291e97949c987b77a0002327fb5 2023-03-11 00:56:07,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 00:56:07,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 00:56:07,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): ed94f2cc321958ef391106e73bef4663/family1 is initiating minor compaction 2023-03-11 00:56:07,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1f963818; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:56:07,221 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ed94f2cc321958ef391106e73bef4663/family1 in testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:07,222 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/e24bcd40b9084d1a928290411dbcfe4a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/15aaa03fcc1e4473ac94962bc7ffc2a2, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/2f5ec4cbecc544949f50b3ed64763782, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/9c1130b3c6f94f4985ce5617db8360cf, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/eeaf270ae8df4a6bb6652f5f1af38c8e, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/88c0f1c4e36f4e578d9fe6dc1ca495a3, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/3a4d1634e9b2415084485e9862fd0e4c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/0bc30e9f40dd486380a48ea493d1f032, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/47704d80c09348d3997c4c7c7d2fc9b1, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/7646dfbe3d3148cdaeade45e519086b4_SeqId_44_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp, totalSize=49.7 K 2023-03-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting e24bcd40b9084d1a928290411dbcfe4a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 15aaa03fcc1e4473ac94962bc7ffc2a2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 2f5ec4cbecc544949f50b3ed64763782, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 9c1130b3c6f94f4985ce5617db8360cf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting eeaf270ae8df4a6bb6652f5f1af38c8e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 88c0f1c4e36f4e578d9fe6dc1ca495a3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 3a4d1634e9b2415084485e9862fd0e4c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 0bc30e9f40dd486380a48ea493d1f032, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 47704d80c09348d3997c4c7c7d2fc9b1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 7646dfbe3d3148cdaeade45e519086b4_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 00:56:07,223 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:56:07,224 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:07,227 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010171edace0575743b784efd3fe4c4f9c11 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010171edace0575743b784efd3fe4c4f9c11 2023-03-11 00:56:07,229 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033013410c1c6b43a78ade5657e5ff9800 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033013410c1c6b43a78ade5657e5ff9800 2023-03-11 00:56:07,229 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-11 00:56:07,229 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-11 00:56:07,229 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:56:07,229 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:56:07,258 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): ed94f2cc321958ef391106e73bef4663#family1#compaction#164 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:56:07,690 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123171b99ba89d85428ea9468de051cb2705 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123171b99ba89d85428ea9468de051cb2705 2023-03-11 00:56:07,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:56:07,711 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/141ec4a3ce3f4eccad5b1f85a86d66a7 first=Optional[r1] last=Optional[r4] 2023-03-11 00:56:07,712 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/141ec4a3ce3f4eccad5b1f85a86d66a7}] 2023-03-11 00:56:07,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/141ec4a3ce3f4eccad5b1f85a86d66a7 for inclusion in ed94f2cc321958ef391106e73bef4663/family1 2023-03-11 00:56:07,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-11 00:56:07,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:56:07,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:07,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/141ec4a3ce3f4eccad5b1f85a86d66a7 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o739daghc8h9dni9teonuqhk32vpkclfe9d8ceqbrb8tha7d3uha2bbsdlvh6arp/family1/141ec4a3ce3f4eccad5b1f85a86d66a7 2023-03-11 00:56:07,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o739daghc8h9dni9teonuqhk32vpkclfe9d8ceqbrb8tha7d3uha2bbsdlvh6arp/family1/141ec4a3ce3f4eccad5b1f85a86d66a7 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/86f23622444247ed948c55d045a2e40d_SeqId_46_ 2023-03-11 00:56:07,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o739daghc8h9dni9teonuqhk32vpkclfe9d8ceqbrb8tha7d3uha2bbsdlvh6arp/family1/141ec4a3ce3f4eccad5b1f85a86d66a7 into ed94f2cc321958ef391106e73bef4663/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/86f23622444247ed948c55d045a2e40d_SeqId_46_ - updating store file list. 2023-03-11 00:56:07,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/86f23622444247ed948c55d045a2e40d_SeqId_46_ into ed94f2cc321958ef391106e73bef4663/family1 2023-03-11 00:56:07,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o739daghc8h9dni9teonuqhk32vpkclfe9d8ceqbrb8tha7d3uha2bbsdlvh6arp/family1/141ec4a3ce3f4eccad5b1f85a86d66a7 into ed94f2cc321958ef391106e73bef4663/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/86f23622444247ed948c55d045a2e40d_SeqId_46_) 2023-03-11 00:56:07,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o739daghc8h9dni9teonuqhk32vpkclfe9d8ceqbrb8tha7d3uha2bbsdlvh6arp/family1/141ec4a3ce3f4eccad5b1f85a86d66a7 2023-03-11 00:56:07,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:56:07,723 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:07,724 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120103e50ffcd0854da5963c634d5f5a1241 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120103e50ffcd0854da5963c634d5f5a1241 2023-03-11 00:56:07,725 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205272df7b05adc45b1a4a337b63dee9205 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205272df7b05adc45b1a4a337b63dee9205 2023-03-11 00:56:07,726 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228921631697eb94a0cbd001609e5eee369 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228921631697eb94a0cbd001609e5eee369 2023-03-11 00:56:07,727 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312227b845bc9d4e73a0dbab2606bec8a6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312227b845bc9d4e73a0dbab2606bec8a6 2023-03-11 00:56:07,727 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-11 00:56:07,727 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-11 00:56:07,728 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:56:07,728 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:56:08,078 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/1db8c7cab91d4e49a974fcf9f754c06b as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/1db8c7cab91d4e49a974fcf9f754c06b 2023-03-11 00:56:08,081 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ed94f2cc321958ef391106e73bef4663/family1 of ed94f2cc321958ef391106e73bef4663 into 1db8c7cab91d4e49a974fcf9f754c06b(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:56:08,082 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:08,082 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678496167221; duration=0sec 2023-03-11 00:56:08,082 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:56:08,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/e24bcd40b9084d1a928290411dbcfe4a, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/15aaa03fcc1e4473ac94962bc7ffc2a2, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/2f5ec4cbecc544949f50b3ed64763782, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/9c1130b3c6f94f4985ce5617db8360cf, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/eeaf270ae8df4a6bb6652f5f1af38c8e, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/88c0f1c4e36f4e578d9fe6dc1ca495a3, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/3a4d1634e9b2415084485e9862fd0e4c, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/0bc30e9f40dd486380a48ea493d1f032, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/47704d80c09348d3997c4c7c7d2fc9b1, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/7646dfbe3d3148cdaeade45e519086b4_SeqId_44_] to archive 2023-03-11 00:56:08,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:08,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/e24bcd40b9084d1a928290411dbcfe4a to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/e24bcd40b9084d1a928290411dbcfe4a 2023-03-11 00:56:08,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/15aaa03fcc1e4473ac94962bc7ffc2a2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/15aaa03fcc1e4473ac94962bc7ffc2a2 2023-03-11 00:56:08,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/2f5ec4cbecc544949f50b3ed64763782 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/2f5ec4cbecc544949f50b3ed64763782 2023-03-11 00:56:08,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/9c1130b3c6f94f4985ce5617db8360cf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/9c1130b3c6f94f4985ce5617db8360cf 2023-03-11 00:56:08,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/eeaf270ae8df4a6bb6652f5f1af38c8e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/eeaf270ae8df4a6bb6652f5f1af38c8e 2023-03-11 00:56:08,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/88c0f1c4e36f4e578d9fe6dc1ca495a3 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/88c0f1c4e36f4e578d9fe6dc1ca495a3 2023-03-11 00:56:08,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/3a4d1634e9b2415084485e9862fd0e4c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/3a4d1634e9b2415084485e9862fd0e4c 2023-03-11 00:56:08,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/0bc30e9f40dd486380a48ea493d1f032 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/0bc30e9f40dd486380a48ea493d1f032 2023-03-11 00:56:08,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/47704d80c09348d3997c4c7c7d2fc9b1 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/47704d80c09348d3997c4c7c7d2fc9b1 2023-03-11 00:56:08,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/7646dfbe3d3148cdaeade45e519086b4_SeqId_44_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/7646dfbe3d3148cdaeade45e519086b4_SeqId_44_ 2023-03-11 00:56:08,558 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f56cdc456ec24d52a8195dbb9545f25d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130f56cdc456ec24d52a8195dbb9545f25d 2023-03-11 00:56:08,559 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:56:08,580 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/144afa157d244de6a6ed01c242e0fafe first=Optional[r00] last=Optional[r8] 2023-03-11 00:56:08,581 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/144afa157d244de6a6ed01c242e0fafe}] 2023-03-11 00:56:08,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/144afa157d244de6a6ed01c242e0fafe for inclusion in ed94f2cc321958ef391106e73bef4663/family1 2023-03-11 00:56:08,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-11 00:56:08,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 00:56:08,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:08,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/144afa157d244de6a6ed01c242e0fafe to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1uphf2adai6i9gpbrn44k2mqnmicnh486s2rtt8heemp9tbftedf4s7a1jchph4v/family1/144afa157d244de6a6ed01c242e0fafe 2023-03-11 00:56:08,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1uphf2adai6i9gpbrn44k2mqnmicnh486s2rtt8heemp9tbftedf4s7a1jchph4v/family1/144afa157d244de6a6ed01c242e0fafe as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/6407852c38684081885df6bf21ab2356_SeqId_49_ 2023-03-11 00:56:08,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1uphf2adai6i9gpbrn44k2mqnmicnh486s2rtt8heemp9tbftedf4s7a1jchph4v/family1/144afa157d244de6a6ed01c242e0fafe into ed94f2cc321958ef391106e73bef4663/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/6407852c38684081885df6bf21ab2356_SeqId_49_ - updating store file list. 2023-03-11 00:56:08,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/6407852c38684081885df6bf21ab2356_SeqId_49_ into ed94f2cc321958ef391106e73bef4663/family1 2023-03-11 00:56:08,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1uphf2adai6i9gpbrn44k2mqnmicnh486s2rtt8heemp9tbftedf4s7a1jchph4v/family1/144afa157d244de6a6ed01c242e0fafe into ed94f2cc321958ef391106e73bef4663/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/6407852c38684081885df6bf21ab2356_SeqId_49_) 2023-03-11 00:56:08,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1uphf2adai6i9gpbrn44k2mqnmicnh486s2rtt8heemp9tbftedf4s7a1jchph4v/family1/144afa157d244de6a6ed01c242e0fafe 2023-03-11 00:56:08,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-11 00:56:08,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-11 00:56:08,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(1912): ed94f2cc321958ef391106e73bef4663/family1 is initiating minor compaction (all files) 2023-03-11 00:56:08,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@68687fc5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:56:08,597 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ed94f2cc321958ef391106e73bef4663/family1 in testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:08,597 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/af5603bd56c741d2b4a952ce2eaabdbf, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/1db8c7cab91d4e49a974fcf9f754c06b, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/86f23622444247ed948c55d045a2e40d_SeqId_46_, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/6407852c38684081885df6bf21ab2356_SeqId_49_] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp, totalSize=344.3 K 2023-03-11 00:56:08,597 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting af5603bd56c741d2b4a952ce2eaabdbf, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839224 2023-03-11 00:56:08,598 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 1db8c7cab91d4e49a974fcf9f754c06b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239224 2023-03-11 00:56:08,598 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 86f23622444247ed948c55d045a2e40d_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965239224 2023-03-11 00:56:08,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:56:08,598 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] compactions.Compactor(207): Compacting 6407852c38684081885df6bf21ab2356_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014839224 2023-03-11 00:56:08,599 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:08,601 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120bf0193a4f67e43819155c61ec311c605 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120bf0193a4f67e43819155c61ec311c605 2023-03-11 00:56:08,602 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511280e10cc938a0a408e910ecbcf8760125e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511280e10cc938a0a408e910ecbcf8760125e 2023-03-11 00:56:08,603 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ce06a8f7eda34b51ade18952bad07209 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ce06a8f7eda34b51ade18952bad07209 2023-03-11 00:56:08,603 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-11 00:56:08,603 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-11 00:56:08,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:56:08,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:56:08,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 00:56:08,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 00:56:08,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:56:08,606 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 00:56:08,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2700 sec 2023-03-11 00:56:08,620 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] throttle.PressureAwareThroughputController(145): ed94f2cc321958ef391106e73bef4663#family1#compaction#165 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:56:08,818 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=258 (was 255) - Thread LEAK? -, OpenFileDescriptor=643 (was 644), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 168) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=5359 (was 5401) 2023-03-11 00:56:08,830 INFO [Listener at localhost/45619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=258, OpenFileDescriptor=643, MaxFileDescriptor=60000, SystemLoadAverage=187, ProcessCount=170, AvailableMemoryMB=5359 2023-03-11 00:56:08,849 DEBUG [Listener at localhost/45619] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-11 00:56:08,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xD3\xBDY\x8C+\x80\xF4\xBB]\x0DK7\x9D\xA3\xA2\xAB"\x106\x13\x17\xC3\xBD6M\x92\x1EL\xDB\x9A\x9EU\x0B\xD9*\x10\xF6\x15\xC0\x5C\xA3\xB4\x0A0o\xE2\xD809\x02\x06{2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-11 00:56:08,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-11 00:56:08,904 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 00:56:08,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-11 00:56:08,904 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 00:56:08,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 00:56:08,906 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:08,906 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:08,906 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:08,906 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca empty. 2023-03-11 00:56:08,906 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6 empty. 2023-03-11 00:56:08,907 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71 empty. 2023-03-11 00:56:08,907 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:08,907 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:08,907 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:08,907 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-11 00:56:08,913 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-11 00:56:08,914 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 3117f002e6ad4ea015cd6759edd92f71, NAME => 'testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xD3\xBDY\x8C+\x80\xF4\xBB]\x0DK7\x9D\xA3\xA2\xAB"\x106\x13\x17\xC3\xBD6M\x92\x1EL\xDB\x9A\x9EU\x0B\xD9*\x10\xF6\x15\xC0\x5C\xA3\xB4\x0A0o\xE2\xD809\x02\x06{2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:56:08,914 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 964d75905ab3241542288e47f2f019e6, NAME => 'testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xD3\xBDY\x8C+\x80\xF4\xBB]\x0DK7\x9D\xA3\xA2\xAB"\x106\x13\x17\xC3\xBD6M\x92\x1EL\xDB\x9A\x9EU\x0B\xD9*\x10\xF6\x15\xC0\x5C\xA3\xB4\x0A0o\xE2\xD809\x02\x06{2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:56:08,914 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8fb50c17bb27da3d117b029e4948fcca, NAME => 'testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xD3\xBDY\x8C+\x80\xF4\xBB]\x0DK7\x9D\xA3\xA2\xAB"\x106\x13\x17\xC3\xBD6M\x92\x1EL\xDB\x9A\x9EU\x0B\xD9*\x10\xF6\x15\xC0\x5C\xA3\xB4\x0A0o\xE2\xD809\x02\x06{2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/.tmp 2023-03-11 00:56:08,927 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:56:08,928 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 964d75905ab3241542288e47f2f019e6, disabling compactions & flushes 2023-03-11 00:56:08,928 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:08,928 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:08,928 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. after waiting 0 ms 2023-03-11 00:56:08,928 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:08,928 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:08,928 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:09,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 00:56:09,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 00:56:09,323 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:56:09,323 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 3117f002e6ad4ea015cd6759edd92f71, disabling compactions & flushes 2023-03-11 00:56:09,323 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:09,323 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:09,323 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. after waiting 0 ms 2023-03-11 00:56:09,323 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:09,324 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:09,324 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:09,326 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:56:09,326 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 8fb50c17bb27da3d117b029e4948fcca, disabling compactions & flushes 2023-03-11 00:56:09,326 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:09,326 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:09,326 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. after waiting 0 ms 2023-03-11 00:56:09,326 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:09,326 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:09,326 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:09,328 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 00:56:09,329 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678496169329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496169329"}]},"ts":"1678496169329"} 2023-03-11 00:56:09,329 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496169329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496169329"}]},"ts":"1678496169329"} 2023-03-11 00:56:09,329 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496169329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678496169329"}]},"ts":"1678496169329"} 2023-03-11 00:56:09,331 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-11 00:56:09,331 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 00:56:09,331 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496169331"}]},"ts":"1678496169331"} 2023-03-11 00:56:09,332 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-11 00:56:09,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8fb50c17bb27da3d117b029e4948fcca, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=964d75905ab3241542288e47f2f019e6, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3117f002e6ad4ea015cd6759edd92f71, ASSIGN}] 2023-03-11 00:56:09,336 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3117f002e6ad4ea015cd6759edd92f71, ASSIGN 2023-03-11 00:56:09,337 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=964d75905ab3241542288e47f2f019e6, ASSIGN 2023-03-11 00:56:09,337 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8fb50c17bb27da3d117b029e4948fcca, ASSIGN 2023-03-11 00:56:09,337 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3117f002e6ad4ea015cd6759edd92f71, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:56:09,337 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=964d75905ab3241542288e47f2f019e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:56:09,337 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8fb50c17bb27da3d117b029e4948fcca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38819,1678496016129; forceNewPlan=false, retain=false 2023-03-11 00:56:09,455 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/.tmp/family1/fdbe3b9136cc427db4eb74b6fa29fc5c as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/fdbe3b9136cc427db4eb74b6fa29fc5c 2023-03-11 00:56:09,459 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in ed94f2cc321958ef391106e73bef4663/family1 of ed94f2cc321958ef391106e73bef4663 into fdbe3b9136cc427db4eb74b6fa29fc5c(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:56:09,459 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:09,459 INFO [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1678496168596; duration=0sec 2023-03-11 00:56:09,459 DEBUG [RS:0;jenkins-hbase4:38819-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 00:56:09,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/af5603bd56c741d2b4a952ce2eaabdbf, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/1db8c7cab91d4e49a974fcf9f754c06b, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/86f23622444247ed948c55d045a2e40d_SeqId_46_, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/6407852c38684081885df6bf21ab2356_SeqId_49_] to archive 2023-03-11 00:56:09,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:09,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/af5603bd56c741d2b4a952ce2eaabdbf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/af5603bd56c741d2b4a952ce2eaabdbf 2023-03-11 00:56:09,489 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=3117f002e6ad4ea015cd6759edd92f71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:09,489 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=8fb50c17bb27da3d117b029e4948fcca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:09,489 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496169489"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496169489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496169489"}]},"ts":"1678496169489"} 2023-03-11 00:56:09,489 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=964d75905ab3241542288e47f2f019e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:09,489 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496169489"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496169489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496169489"}]},"ts":"1678496169489"} 2023-03-11 00:56:09,489 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678496169489"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678496169489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678496169489"}]},"ts":"1678496169489"} 2023-03-11 00:56:09,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/1db8c7cab91d4e49a974fcf9f754c06b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/1db8c7cab91d4e49a974fcf9f754c06b 2023-03-11 00:56:09,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 3117f002e6ad4ea015cd6759edd92f71, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:56:09,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure 8fb50c17bb27da3d117b029e4948fcca, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:56:09,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/86f23622444247ed948c55d045a2e40d_SeqId_46_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/86f23622444247ed948c55d045a2e40d_SeqId_46_ 2023-03-11 00:56:09,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 964d75905ab3241542288e47f2f019e6, server=jenkins-hbase4.apache.org,38819,1678496016129}] 2023-03-11 00:56:09,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/6407852c38684081885df6bf21ab2356_SeqId_49_ to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/family1/6407852c38684081885df6bf21ab2356_SeqId_49_ 2023-03-11 00:56:09,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 00:56:09,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:09,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3117f002e6ad4ea015cd6759edd92f71, NAME => 'testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71.', STARTKEY => '2', ENDKEY => ''} 2023-03-11 00:56:09,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:09,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:56:09,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:09,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:09,666 INFO [StoreOpener-3117f002e6ad4ea015cd6759edd92f71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:09,667 DEBUG [StoreOpener-3117f002e6ad4ea015cd6759edd92f71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1 2023-03-11 00:56:09,668 DEBUG [StoreOpener-3117f002e6ad4ea015cd6759edd92f71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1 2023-03-11 00:56:09,668 INFO [StoreOpener-3117f002e6ad4ea015cd6759edd92f71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3117f002e6ad4ea015cd6759edd92f71 columnFamilyName family1 2023-03-11 00:56:09,669 INFO [StoreOpener-3117f002e6ad4ea015cd6759edd92f71-1] regionserver.HStore(310): Store=3117f002e6ad4ea015cd6759edd92f71/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:56:09,669 INFO [StoreOpener-3117f002e6ad4ea015cd6759edd92f71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:09,670 DEBUG [StoreOpener-3117f002e6ad4ea015cd6759edd92f71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2 2023-03-11 00:56:09,670 DEBUG [StoreOpener-3117f002e6ad4ea015cd6759edd92f71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2 2023-03-11 00:56:09,671 INFO [StoreOpener-3117f002e6ad4ea015cd6759edd92f71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3117f002e6ad4ea015cd6759edd92f71 columnFamilyName family2 2023-03-11 00:56:09,672 INFO [StoreOpener-3117f002e6ad4ea015cd6759edd92f71-1] regionserver.HStore(310): Store=3117f002e6ad4ea015cd6759edd92f71/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:56:09,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:09,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:09,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:56:09,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:09,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:56:09,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3117f002e6ad4ea015cd6759edd92f71; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67286085, jitterRate=0.0026407986879348755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:56:09,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:09,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71., pid=120, masterSystemTime=1678496169642 2023-03-11 00:56:09,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:09,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:09,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:09,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fb50c17bb27da3d117b029e4948fcca, NAME => 'testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca.', STARTKEY => '', ENDKEY => '1'} 2023-03-11 00:56:09,678 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=3117f002e6ad4ea015cd6759edd92f71, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:09,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:09,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:56:09,678 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496169678"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496169678"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496169678"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496169678"}]},"ts":"1678496169678"} 2023-03-11 00:56:09,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:09,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:09,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-03-11 00:56:09,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 3117f002e6ad4ea015cd6759edd92f71, server=jenkins-hbase4.apache.org,38819,1678496016129 in 189 msec 2023-03-11 00:56:09,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3117f002e6ad4ea015cd6759edd92f71, ASSIGN in 346 msec 2023-03-11 00:56:09,698 INFO [StoreOpener-8fb50c17bb27da3d117b029e4948fcca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:09,699 DEBUG [StoreOpener-8fb50c17bb27da3d117b029e4948fcca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1 2023-03-11 00:56:09,699 DEBUG [StoreOpener-8fb50c17bb27da3d117b029e4948fcca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1 2023-03-11 00:56:09,699 INFO [StoreOpener-8fb50c17bb27da3d117b029e4948fcca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fb50c17bb27da3d117b029e4948fcca columnFamilyName family1 2023-03-11 00:56:09,700 INFO [StoreOpener-8fb50c17bb27da3d117b029e4948fcca-1] regionserver.HStore(310): Store=8fb50c17bb27da3d117b029e4948fcca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:56:09,700 INFO [StoreOpener-8fb50c17bb27da3d117b029e4948fcca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:09,701 DEBUG [StoreOpener-8fb50c17bb27da3d117b029e4948fcca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2 2023-03-11 00:56:09,701 DEBUG [StoreOpener-8fb50c17bb27da3d117b029e4948fcca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2 2023-03-11 00:56:09,701 INFO [StoreOpener-8fb50c17bb27da3d117b029e4948fcca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fb50c17bb27da3d117b029e4948fcca columnFamilyName family2 2023-03-11 00:56:09,702 INFO [StoreOpener-8fb50c17bb27da3d117b029e4948fcca-1] regionserver.HStore(310): Store=8fb50c17bb27da3d117b029e4948fcca/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:56:09,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:09,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:09,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:56:09,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:09,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:56:09,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8fb50c17bb27da3d117b029e4948fcca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71707743, jitterRate=0.06852863729000092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:56:09,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:09,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca., pid=121, masterSystemTime=1678496169642 2023-03-11 00:56:09,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:09,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:09,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:09,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 964d75905ab3241542288e47f2f019e6, NAME => 'testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6.', STARTKEY => '1', ENDKEY => '2'} 2023-03-11 00:56:09,708 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=8fb50c17bb27da3d117b029e4948fcca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:09,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:09,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 00:56:09,708 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678496169708"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496169708"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496169708"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496169708"}]},"ts":"1678496169708"} 2023-03-11 00:56:09,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:09,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:09,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=117 2023-03-11 00:56:09,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure 8fb50c17bb27da3d117b029e4948fcca, server=jenkins-hbase4.apache.org,38819,1678496016129 in 218 msec 2023-03-11 00:56:09,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8fb50c17bb27da3d117b029e4948fcca, ASSIGN in 375 msec 2023-03-11 00:56:09,730 INFO [StoreOpener-964d75905ab3241542288e47f2f019e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:09,732 DEBUG [StoreOpener-964d75905ab3241542288e47f2f019e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1 2023-03-11 00:56:09,732 DEBUG [StoreOpener-964d75905ab3241542288e47f2f019e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1 2023-03-11 00:56:09,732 INFO [StoreOpener-964d75905ab3241542288e47f2f019e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 964d75905ab3241542288e47f2f019e6 columnFamilyName family1 2023-03-11 00:56:09,733 INFO [StoreOpener-964d75905ab3241542288e47f2f019e6-1] regionserver.HStore(310): Store=964d75905ab3241542288e47f2f019e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:56:09,733 INFO [StoreOpener-964d75905ab3241542288e47f2f019e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:09,734 DEBUG [StoreOpener-964d75905ab3241542288e47f2f019e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2 2023-03-11 00:56:09,734 DEBUG [StoreOpener-964d75905ab3241542288e47f2f019e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2 2023-03-11 00:56:09,734 INFO [StoreOpener-964d75905ab3241542288e47f2f019e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 964d75905ab3241542288e47f2f019e6 columnFamilyName family2 2023-03-11 00:56:09,735 INFO [StoreOpener-964d75905ab3241542288e47f2f019e6-1] regionserver.HStore(310): Store=964d75905ab3241542288e47f2f019e6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 00:56:09,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:09,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:09,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 00:56:09,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:09,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 00:56:09,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 964d75905ab3241542288e47f2f019e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60710083, jitterRate=-0.0953492671251297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 00:56:09,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:09,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6., pid=122, masterSystemTime=1678496169642 2023-03-11 00:56:09,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:09,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:09,741 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=964d75905ab3241542288e47f2f019e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:09,742 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678496169741"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678496169741"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678496169741"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678496169741"}]},"ts":"1678496169741"} 2023-03-11 00:56:09,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-03-11 00:56:09,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 964d75905ab3241542288e47f2f019e6, server=jenkins-hbase4.apache.org,38819,1678496016129 in 251 msec 2023-03-11 00:56:09,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-03-11 00:56:09,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=964d75905ab3241542288e47f2f019e6, ASSIGN in 409 msec 2023-03-11 00:56:09,745 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 00:56:09,745 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678496169745"}]},"ts":"1678496169745"} 2023-03-11 00:56:09,746 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-11 00:56:09,749 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 00:56:09,750 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 848 msec 2023-03-11 00:56:10,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 00:56:10,008 INFO [Listener at localhost/45619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-11 00:56:10,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:10,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:10,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:10,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:10,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-11 00:56:10,019 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-11 00:56:10,019 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:10,019 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-11 00:56:10,019 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-11 00:56:10,019 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:10,019 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:10,023 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:10,023 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:10,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:10,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:10,024 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:10,024 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:10,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:10,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:10,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:10,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:10,025 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-11 00:56:10,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-11 00:56:10,025 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-11 00:56:10,025 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:10,025 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-11 00:56:10,025 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:10,025 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. started... 2023-03-11 00:56:10,025 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:10,025 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:56:10,025 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:10,025 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. started... 2023-03-11 00:56:10,025 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:10,026 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 964d75905ab3241542288e47f2f019e6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 00:56:10,027 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. started... 2023-03-11 00:56:10,027 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8fb50c17bb27da3d117b029e4948fcca 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 00:56:10,027 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3117f002e6ad4ea015cd6759edd92f71 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 00:56:10,077 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031161fb714cd1104bdd8f1ab4dfc3ac66cf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031161fb714cd1104bdd8f1ab4dfc3ac66cf 2023-03-11 00:56:10,478 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311828a45b3a4e94a37a43b1350c2f31665 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311828a45b3a4e94a37a43b1350c2f31665 2023-03-11 00:56:10,482 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311390c96ba6bb340b0b75002b8b1c5e9bf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311390c96ba6bb340b0b75002b8b1c5e9bf 2023-03-11 00:56:10,492 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/39762926c0134dbe8dede5a8a5e654a9 2023-03-11 00:56:10,496 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/5190a35d032e4237a163d4bb1798725b 2023-03-11 00:56:10,525 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303115a3d8cb9e8114dd9ad8b3cce315b947c to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303115a3d8cb9e8114dd9ad8b3cce315b947c 2023-03-11 00:56:10,530 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/74e475c834b446699dbeebcb3223959f 2023-03-11 00:56:10,534 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/5190a35d032e4237a163d4bb1798725b as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/5190a35d032e4237a163d4bb1798725b 2023-03-11 00:56:10,537 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311c600bc80ca1f4dfca416b9d49d74c0d6 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230311c600bc80ca1f4dfca416b9d49d74c0d6 2023-03-11 00:56:10,541 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/7e3a09b7545f4a59b00c27cb1f02daf4 2023-03-11 00:56:10,544 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/39762926c0134dbe8dede5a8a5e654a9 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/39762926c0134dbe8dede5a8a5e654a9 2023-03-11 00:56:10,560 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/5190a35d032e4237a163d4bb1798725b, entries=4, sequenceid=5, filesize=5.5 K 2023-03-11 00:56:10,561 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/74e475c834b446699dbeebcb3223959f as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/74e475c834b446699dbeebcb3223959f 2023-03-11 00:56:10,564 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/74e475c834b446699dbeebcb3223959f, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 00:56:10,565 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3117f002e6ad4ea015cd6759edd92f71 in 538ms, sequenceid=5, compaction requested=false 2023-03-11 00:56:10,565 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-11 00:56:10,565 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:10,565 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:10,565 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:56:10,566 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/39762926c0134dbe8dede5a8a5e654a9, entries=4, sequenceid=5, filesize=5.5 K 2023-03-11 00:56:10,566 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/7e3a09b7545f4a59b00c27cb1f02daf4 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/7e3a09b7545f4a59b00c27cb1f02daf4 2023-03-11 00:56:10,569 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/7e3a09b7545f4a59b00c27cb1f02daf4, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 00:56:10,570 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 964d75905ab3241542288e47f2f019e6 in 544ms, sequenceid=5, compaction requested=false 2023-03-11 00:56:10,571 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:10,571 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:10,571 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:56:10,893 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/f34d0645e4bf403fbfbc9f919276fc23 2023-03-11 00:56:11,335 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303119a886fb7407843d2930e6ae8f374e58f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303119a886fb7407843d2930e6ae8f374e58f 2023-03-11 00:56:11,740 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/67deeff31cc04d3bba7a1e199f68dd2e 2023-03-11 00:56:11,744 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/f34d0645e4bf403fbfbc9f919276fc23 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/f34d0645e4bf403fbfbc9f919276fc23 2023-03-11 00:56:11,779 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/f34d0645e4bf403fbfbc9f919276fc23, entries=4, sequenceid=5, filesize=5.5 K 2023-03-11 00:56:11,780 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/67deeff31cc04d3bba7a1e199f68dd2e as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/67deeff31cc04d3bba7a1e199f68dd2e 2023-03-11 00:56:11,783 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/67deeff31cc04d3bba7a1e199f68dd2e, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 00:56:11,784 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8fb50c17bb27da3d117b029e4948fcca in 1757ms, sequenceid=5, compaction requested=false 2023-03-11 00:56:11,784 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:11,784 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:11,784 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:56:11,784 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:56:11,784 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,784 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-11 00:56:11,784 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-11 00:56:11,786 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:11,786 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:11,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:11,786 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:11,786 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:11,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:11,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:11,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:11,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:11,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-11 00:56:11,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@392bd9bf[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:11,787 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-11 00:56:11,787 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:11,789 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:11,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:11,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:11,789 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-11 00:56:11,789 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-11 00:56:11,789 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:11,789 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,789 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:11,790 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,790 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-11 00:56:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:11,790 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:11,790 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-11 00:56:11,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:11,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:11,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:11,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:11,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-11 00:56:11,792 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-11 00:56:11,792 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:11,792 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:11,792 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-11 00:56:11,793 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:11,794 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:11,794 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:11,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:11,794 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:11,794 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:11,795 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:11,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:11,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,797 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,797 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:11,797 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:11,797 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,797 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:11,797 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:11,797 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:11,797 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:11,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:11,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-11 00:56:11,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:11,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-11 00:56:11,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:11,797 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:11,797 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:11,798 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:11,798 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:11,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:11,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:11,898 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:11,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:11,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:11,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:11,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:11,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:11,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:11,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-11 00:56:11,905 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-11 00:56:11,905 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:11,905 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-11 00:56:11,905 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-11 00:56:11,905 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:11,905 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:11,908 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:11,908 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:11,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:11,908 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:11,909 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:11,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:11,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:11,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:11,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:11,909 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-11 00:56:11,909 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-11 00:56:11,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-11 00:56:11,910 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-11 00:56:11,910 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:11,910 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-11 00:56:11,910 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:11,910 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. started... 2023-03-11 00:56:11,910 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 964d75905ab3241542288e47f2f019e6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 00:56:11,911 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:56:11,911 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:11,911 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:11,911 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:11,911 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. started... 2023-03-11 00:56:11,911 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. started... 2023-03-11 00:56:11,911 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8fb50c17bb27da3d117b029e4948fcca 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 00:56:11,911 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3117f002e6ad4ea015cd6759edd92f71 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 00:56:12,351 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311035480f7c3004a49b8919aee14b84abe to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311035480f7c3004a49b8919aee14b84abe 2023-03-11 00:56:12,358 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311194839c697d844b4a76eaddb08505938 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311194839c697d844b4a76eaddb08505938 2023-03-11 00:56:12,362 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311e4ce15b22c8a420bb1a7addfc1aa375d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311e4ce15b22c8a420bb1a7addfc1aa375d 2023-03-11 00:56:12,383 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/6107ff01624f48bf80512b5f59e56cfa 2023-03-11 00:56:12,766 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/a89441c3f5274e8a9a055bf8f745ad5f 2023-03-11 00:56:12,776 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/b8e6237c0e7542cfa78b5857eed294fa 2023-03-11 00:56:12,827 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031158970b16b6754074ba66d7a2cf5415a3 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023031158970b16b6754074ba66d7a2cf5415a3 2023-03-11 00:56:13,199 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031154efdfb35b4f49f3a5814237b1b48762 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023031154efdfb35b4f49f3a5814237b1b48762 2023-03-11 00:56:13,206 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303117d34586d8f354c6fa2add9956ef9f4e9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303117d34586d8f354c6fa2add9956ef9f4e9 2023-03-11 00:56:13,231 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/ab005422ff3848e4a3d645c8d1214713 2023-03-11 00:56:13,235 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/6107ff01624f48bf80512b5f59e56cfa as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/6107ff01624f48bf80512b5f59e56cfa 2023-03-11 00:56:13,257 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/6107ff01624f48bf80512b5f59e56cfa, entries=4, sequenceid=9, filesize=5.5 K 2023-03-11 00:56:13,258 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/ab005422ff3848e4a3d645c8d1214713 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/ab005422ff3848e4a3d645c8d1214713 2023-03-11 00:56:13,261 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/ab005422ff3848e4a3d645c8d1214713, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 00:56:13,262 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 964d75905ab3241542288e47f2f019e6 in 1352ms, sequenceid=9, compaction requested=false 2023-03-11 00:56:13,262 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:13,262 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:13,262 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:56:13,604 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/13a0d340883c4296b048cf307d1fdf90 2023-03-11 00:56:13,608 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/a89441c3f5274e8a9a055bf8f745ad5f as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/a89441c3f5274e8a9a055bf8f745ad5f 2023-03-11 00:56:13,610 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/3789e091e753480bad1c7fe127d77313 2023-03-11 00:56:13,615 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/b8e6237c0e7542cfa78b5857eed294fa as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/b8e6237c0e7542cfa78b5857eed294fa 2023-03-11 00:56:13,631 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/a89441c3f5274e8a9a055bf8f745ad5f, entries=4, sequenceid=9, filesize=5.5 K 2023-03-11 00:56:13,631 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/13a0d340883c4296b048cf307d1fdf90 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/13a0d340883c4296b048cf307d1fdf90 2023-03-11 00:56:13,634 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/13a0d340883c4296b048cf307d1fdf90, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 00:56:13,635 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3117f002e6ad4ea015cd6759edd92f71 in 1724ms, sequenceid=9, compaction requested=false 2023-03-11 00:56:13,635 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:13,635 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:13,635 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:56:13,648 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/b8e6237c0e7542cfa78b5857eed294fa, entries=4, sequenceid=9, filesize=5.5 K 2023-03-11 00:56:13,648 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/3789e091e753480bad1c7fe127d77313 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/3789e091e753480bad1c7fe127d77313 2023-03-11 00:56:13,651 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/3789e091e753480bad1c7fe127d77313, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 00:56:13,652 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8fb50c17bb27da3d117b029e4948fcca in 1741ms, sequenceid=9, compaction requested=false 2023-03-11 00:56:13,652 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:13,652 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:13,652 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:56:13,652 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:56:13,652 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,652 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-11 00:56:13,652 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-11 00:56:13,654 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,654 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:13,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:13,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:13,654 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:13,654 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:13,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:13,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:13,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:13,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:13,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-11 00:56:13,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ac01f9f[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:13,655 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-11 00:56:13,656 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:13,656 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:13,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:13,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:13,657 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,657 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:13,657 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-11 00:56:13,657 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-11 00:56:13,657 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:13,658 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-11 00:56:13,658 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:13,658 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-11 00:56:13,659 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:13,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:13,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:13,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:13,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:13,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:13,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:13,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:13,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-11 00:56:13,661 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-11 00:56:13,661 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:13,661 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:13,661 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-11 00:56:13,661 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:13,665 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:13,665 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:13,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:13,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:13,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:13,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:13,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:13,665 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:13,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:13,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:13,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:13,665 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:13,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:13,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:13,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:13,666 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:13,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:13,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:13,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,668 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:13,669 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:13,669 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:13,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-11 00:56:13,669 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,669 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:13,669 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:13,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:13,669 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:13,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:13,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-11 00:56:13,669 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:13,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:13,669 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:13,669 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:13,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:13,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:13,769 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:13,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:13,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:13,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:13,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:13,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:13,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:13,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-11 00:56:13,775 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-11 00:56:13,775 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:13,775 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-11 00:56:13,775 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-11 00:56:13,775 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:13,776 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:13,777 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:13,777 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:13,778 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:13,778 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:13,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:13,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:13,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:13,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:13,778 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-11 00:56:13,778 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-11 00:56:13,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-11 00:56:13,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-11 00:56:13,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:13,778 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-11 00:56:13,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:13,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. started... 2023-03-11 00:56:13,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:13,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:13,779 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 964d75905ab3241542288e47f2f019e6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 00:56:13,779 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:56:13,779 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:13,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. started... 2023-03-11 00:56:13,779 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. started... 2023-03-11 00:56:13,779 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3117f002e6ad4ea015cd6759edd92f71 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 00:56:13,779 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8fb50c17bb27da3d117b029e4948fcca 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 00:56:13,829 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311232a45899ce94c528774d731858661cd to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311232a45899ce94c528774d731858661cd 2023-03-11 00:56:13,830 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311c693721886bd460ea5a048eb981073ca to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311c693721886bd460ea5a048eb981073ca 2023-03-11 00:56:14,225 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311d676395f44e44450a98d7cc888e5e806 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311d676395f44e44450a98d7cc888e5e806 2023-03-11 00:56:14,244 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/d98f4fafc8854b38bd1d609329ea58fe 2023-03-11 00:56:14,250 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/c425a86cb6214826b6a256bd59e25d4f 2023-03-11 00:56:14,639 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/2c31762bbeab4abf80348d0e24175996 2023-03-11 00:56:14,685 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303112d0088c14505468b8552e3496eb40fd8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303112d0088c14505468b8552e3496eb40fd8 2023-03-11 00:56:14,685 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311f0b51ef020054aaab670e009f26962a3 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230311f0b51ef020054aaab670e009f26962a3 2023-03-11 00:56:14,693 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/8fe6a441fd184058a43a1c42edde8bd3 2023-03-11 00:56:14,696 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/d98f4fafc8854b38bd1d609329ea58fe as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/d98f4fafc8854b38bd1d609329ea58fe 2023-03-11 00:56:14,718 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/d98f4fafc8854b38bd1d609329ea58fe, entries=4, sequenceid=13, filesize=5.5 K 2023-03-11 00:56:14,719 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/8fe6a441fd184058a43a1c42edde8bd3 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/8fe6a441fd184058a43a1c42edde8bd3 2023-03-11 00:56:14,722 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/8fe6a441fd184058a43a1c42edde8bd3, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 00:56:14,723 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3117f002e6ad4ea015cd6759edd92f71 in 944ms, sequenceid=13, compaction requested=true 2023-03-11 00:56:14,723 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:14,723 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:14,723 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:56:15,073 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311437ff7dc231d494c8171dc88c7e4670d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230311437ff7dc231d494c8171dc88c7e4670d 2023-03-11 00:56:15,094 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/7a49e38e42cf47e9bd61d8a308017631 2023-03-11 00:56:15,097 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/c425a86cb6214826b6a256bd59e25d4f as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/c425a86cb6214826b6a256bd59e25d4f 2023-03-11 00:56:15,120 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/c425a86cb6214826b6a256bd59e25d4f, entries=4, sequenceid=13, filesize=5.5 K 2023-03-11 00:56:15,121 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/7a49e38e42cf47e9bd61d8a308017631 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/7a49e38e42cf47e9bd61d8a308017631 2023-03-11 00:56:15,128 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/7a49e38e42cf47e9bd61d8a308017631, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 00:56:15,128 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8fb50c17bb27da3d117b029e4948fcca in 1349ms, sequenceid=13, compaction requested=true 2023-03-11 00:56:15,129 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:15,129 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:15,129 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:56:15,183 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 00:56:15,478 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/adf2e3acdd6148488c4cc9ad6bc29961 2023-03-11 00:56:15,483 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/2c31762bbeab4abf80348d0e24175996 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/2c31762bbeab4abf80348d0e24175996 2023-03-11 00:56:15,506 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/2c31762bbeab4abf80348d0e24175996, entries=4, sequenceid=13, filesize=5.5 K 2023-03-11 00:56:15,506 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/adf2e3acdd6148488c4cc9ad6bc29961 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/adf2e3acdd6148488c4cc9ad6bc29961 2023-03-11 00:56:15,510 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/adf2e3acdd6148488c4cc9ad6bc29961, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 00:56:15,511 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 964d75905ab3241542288e47f2f019e6 in 1732ms, sequenceid=13, compaction requested=true 2023-03-11 00:56:15,511 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:15,511 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:15,511 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:56:15,511 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:56:15,511 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,511 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-11 00:56:15,511 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-11 00:56:15,512 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,512 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:15,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:15,513 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:15,513 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:15,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-11 00:56:15,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38de9aaa[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:15,514 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-11 00:56:15,514 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:15,516 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:15,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:15,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:15,516 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,516 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:15,516 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-11 00:56:15,516 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-11 00:56:15,516 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:15,517 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-11 00:56:15,517 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:15,517 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,517 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-11 00:56:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:15,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-11 00:56:15,519 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-11 00:56:15,519 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:15,519 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:15,519 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-11 00:56:15,519 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:15,520 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:15,520 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:15,521 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:15,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:15,521 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:15,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:15,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:15,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,522 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:15,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:15,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,524 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:15,524 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:15,524 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:15,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-11 00:56:15,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-11 00:56:15,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:15,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:15,524 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:15,525 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:15,525 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:15,525 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,525 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:15,525 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:15,525 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:15,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:15,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:15,525 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:15,525 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:15,625 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:15,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:15,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:15,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:15,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 00:56:15,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:15,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:15,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-11 00:56:15,632 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-11 00:56:15,632 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:15,632 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-11 00:56:15,632 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-11 00:56:15,632 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:15,633 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:15,637 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:15,637 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:15,638 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:15,638 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:15,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:15,638 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-11 00:56:15,639 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-11 00:56:15,639 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-11 00:56:15,639 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-11 00:56:15,639 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:15,639 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-11 00:56:15,639 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:15,639 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. started... 2023-03-11 00:56:15,639 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:56:15,639 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:15,639 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 964d75905ab3241542288e47f2f019e6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 00:56:15,639 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:15,639 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:15,639 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. started... 2023-03-11 00:56:15,639 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. started... 2023-03-11 00:56:15,639 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8fb50c17bb27da3d117b029e4948fcca 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 00:56:15,639 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3117f002e6ad4ea015cd6759edd92f71 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 00:56:16,089 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311885d3a31ab9f41bb81ad9fdafd591330 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311885d3a31ab9f41bb81ad9fdafd591330 2023-03-11 00:56:16,091 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311a653caf2fa1f4bc2ab01714f349cf2d2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311a653caf2fa1f4bc2ab01714f349cf2d2 2023-03-11 00:56:16,112 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311a4ae8d4cd5864f5094f939ad936bff6e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311a4ae8d4cd5864f5094f939ad936bff6e 2023-03-11 00:56:16,517 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/4e023361cc204311bf1394a86a4dcdfe 2023-03-11 00:56:16,517 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/77e2c435a4bc41eebc840f42491d0d7d 2023-03-11 00:56:16,533 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/610d1cf101d74c93ae96d5de79c3cbcf 2023-03-11 00:56:16,965 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311eba683eda448499fb5f59ae2c7cd7e07 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230311eba683eda448499fb5f59ae2c7cd7e07 2023-03-11 00:56:16,972 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311a6ab21eb49b04e10ac6552802751d1dc to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230311a6ab21eb49b04e10ac6552802751d1dc 2023-03-11 00:56:16,974 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031176b23db1975547bfaaa405e22b486a34 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023031176b23db1975547bfaaa405e22b486a34 2023-03-11 00:56:16,980 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/da43974efd744a3cb6f4754287d43b4f 2023-03-11 00:56:16,983 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/610d1cf101d74c93ae96d5de79c3cbcf as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/610d1cf101d74c93ae96d5de79c3cbcf 2023-03-11 00:56:17,008 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/610d1cf101d74c93ae96d5de79c3cbcf, entries=4, sequenceid=17, filesize=5.5 K 2023-03-11 00:56:17,009 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/da43974efd744a3cb6f4754287d43b4f as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/da43974efd744a3cb6f4754287d43b4f 2023-03-11 00:56:17,012 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/da43974efd744a3cb6f4754287d43b4f, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 00:56:17,013 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3117f002e6ad4ea015cd6759edd92f71 in 1374ms, sequenceid=17, compaction requested=true 2023-03-11 00:56:17,013 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:17,013 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:17,013 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:56:17,370 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/9b5845deb7e549faa5df53e22e650e33 2023-03-11 00:56:17,378 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/85186ad12d65435f8b6fe843c7133d6f 2023-03-11 00:56:17,379 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/77e2c435a4bc41eebc840f42491d0d7d as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/77e2c435a4bc41eebc840f42491d0d7d 2023-03-11 00:56:17,382 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/4e023361cc204311bf1394a86a4dcdfe as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/4e023361cc204311bf1394a86a4dcdfe 2023-03-11 00:56:17,411 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/77e2c435a4bc41eebc840f42491d0d7d, entries=4, sequenceid=17, filesize=5.5 K 2023-03-11 00:56:17,412 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/9b5845deb7e549faa5df53e22e650e33 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/9b5845deb7e549faa5df53e22e650e33 2023-03-11 00:56:17,418 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/4e023361cc204311bf1394a86a4dcdfe, entries=4, sequenceid=17, filesize=5.5 K 2023-03-11 00:56:17,418 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/9b5845deb7e549faa5df53e22e650e33, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 00:56:17,419 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/85186ad12d65435f8b6fe843c7133d6f as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/85186ad12d65435f8b6fe843c7133d6f 2023-03-11 00:56:17,419 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8fb50c17bb27da3d117b029e4948fcca in 1780ms, sequenceid=17, compaction requested=true 2023-03-11 00:56:17,419 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:17,419 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:17,420 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:56:17,425 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/85186ad12d65435f8b6fe843c7133d6f, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 00:56:17,426 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 964d75905ab3241542288e47f2f019e6 in 1787ms, sequenceid=17, compaction requested=true 2023-03-11 00:56:17,426 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:17,426 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:17,426 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:56:17,426 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:56:17,426 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,426 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-11 00:56:17,426 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-11 00:56:17,428 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:17,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:17,428 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:17,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-11 00:56:17,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@644ed79d[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:17,430 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-11 00:56:17,430 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:17,431 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:17,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:17,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:17,431 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-11 00:56:17,431 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,431 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:17,431 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-11 00:56:17,431 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:17,432 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,432 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-11 00:56:17,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:17,432 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:17,433 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-11 00:56:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:17,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:17,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:17,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-11 00:56:17,435 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-11 00:56:17,435 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:17,435 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:17,435 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-11 00:56:17,435 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:17,437 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:17,438 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:17,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:17,438 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:17,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:17,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:17,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:17,439 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:17,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:17,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:17,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:17,440 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:17,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:17,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:17,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:17,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-11 00:56:17,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-11 00:56:17,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:17,443 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:17,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:17,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:17,443 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:17,543 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:17,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:17,554 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:56:17,562 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:56:17,570 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:56:17,571 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:56:17,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-11 00:56:17,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-11 00:56:17,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-11 00:56:17,659 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-11 00:56:17,659 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:17,659 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-11 00:56:17,659 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-11 00:56:17,659 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:17,659 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:17,661 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,661 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:17,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:17,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:17,661 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:17,661 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 00:56:17,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:17,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:17,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 00:56:17,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:17,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-11 00:56:17,662 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-11 00:56:17,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-11 00:56:17,662 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-11 00:56:17,662 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 00:56:17,662 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-11 00:56:17,663 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:17,663 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. started... 2023-03-11 00:56:17,663 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 964d75905ab3241542288e47f2f019e6 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 00:56:17,663 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 00:56:17,663 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:17,663 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:17,663 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 00:56:17,663 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. started... 2023-03-11 00:56:17,663 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. started... 2023-03-11 00:56:17,663 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3117f002e6ad4ea015cd6759edd92f71 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 00:56:17,663 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8fb50c17bb27da3d117b029e4948fcca 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 00:56:18,117 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/d0c734ee62c14c288df3210065a40953 2023-03-11 00:56:18,141 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0c734ee62c14c288df3210065a40953 2023-03-11 00:56:18,510 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/1b870645a1e34eec9da8040db190eace 2023-03-11 00:56:18,517 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/ff0e474f1e5c4bb2a08676fb5f7131b9 2023-03-11 00:56:18,533 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b870645a1e34eec9da8040db190eace 2023-03-11 00:56:18,539 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff0e474f1e5c4bb2a08676fb5f7131b9 2023-03-11 00:56:18,552 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/8f8dc511fabb4a978735bf8632c1ca89 2023-03-11 00:56:18,555 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f8dc511fabb4a978735bf8632c1ca89 2023-03-11 00:56:18,556 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/d0c734ee62c14c288df3210065a40953 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/d0c734ee62c14c288df3210065a40953 2023-03-11 00:56:18,563 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/57e19e568dce4b39bf2762e4a42b59fd 2023-03-11 00:56:18,566 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57e19e568dce4b39bf2762e4a42b59fd 2023-03-11 00:56:18,567 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/ff0e474f1e5c4bb2a08676fb5f7131b9 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/ff0e474f1e5c4bb2a08676fb5f7131b9 2023-03-11 00:56:18,581 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0c734ee62c14c288df3210065a40953 2023-03-11 00:56:18,581 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/d0c734ee62c14c288df3210065a40953, entries=3, sequenceid=23, filesize=5.2 K 2023-03-11 00:56:18,582 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/8f8dc511fabb4a978735bf8632c1ca89 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/8f8dc511fabb4a978735bf8632c1ca89 2023-03-11 00:56:18,587 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f8dc511fabb4a978735bf8632c1ca89 2023-03-11 00:56:18,587 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/8f8dc511fabb4a978735bf8632c1ca89, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 00:56:18,588 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8fb50c17bb27da3d117b029e4948fcca in 925ms, sequenceid=23, compaction requested=true 2023-03-11 00:56:18,588 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:18,588 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:18,588 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 00:56:18,593 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff0e474f1e5c4bb2a08676fb5f7131b9 2023-03-11 00:56:18,593 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/ff0e474f1e5c4bb2a08676fb5f7131b9, entries=3, sequenceid=23, filesize=5.2 K 2023-03-11 00:56:18,594 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/57e19e568dce4b39bf2762e4a42b59fd as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/57e19e568dce4b39bf2762e4a42b59fd 2023-03-11 00:56:18,597 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57e19e568dce4b39bf2762e4a42b59fd 2023-03-11 00:56:18,597 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/57e19e568dce4b39bf2762e4a42b59fd, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 00:56:18,598 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 964d75905ab3241542288e47f2f019e6 in 935ms, sequenceid=23, compaction requested=true 2023-03-11 00:56:18,598 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:18,598 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:18,598 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 00:56:18,953 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/dd46b37b2f69455abcf7082203604514 2023-03-11 00:56:18,958 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd46b37b2f69455abcf7082203604514 2023-03-11 00:56:18,958 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/1b870645a1e34eec9da8040db190eace as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/1b870645a1e34eec9da8040db190eace 2023-03-11 00:56:18,982 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b870645a1e34eec9da8040db190eace 2023-03-11 00:56:18,982 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/1b870645a1e34eec9da8040db190eace, entries=3, sequenceid=23, filesize=5.2 K 2023-03-11 00:56:18,983 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/dd46b37b2f69455abcf7082203604514 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/dd46b37b2f69455abcf7082203604514 2023-03-11 00:56:18,987 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd46b37b2f69455abcf7082203604514 2023-03-11 00:56:18,987 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/dd46b37b2f69455abcf7082203604514, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 00:56:18,988 INFO [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3117f002e6ad4ea015cd6759edd92f71 in 1325ms, sequenceid=23, compaction requested=true 2023-03-11 00:56:18,988 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:18,988 DEBUG [rs(jenkins-hbase4.apache.org,38819,1678496016129)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 00:56:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 00:56:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-11 00:56:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-11 00:56:18,990 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:18,990 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:18,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:18,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:18,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:18,990 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:18,990 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 00:56:18,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:18,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:18,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:18,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:18,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:18,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38819,1678496016129' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-11 00:56:18,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cf0c8a[Count = 0] remaining members to acquire global barrier 2023-03-11 00:56:18,992 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-11 00:56:18,992 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:18,993 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:18,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:18,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:18,993 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-11 00:56:18,993 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-11 00:56:18,993 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38819,1678496016129' in zk 2023-03-11 00:56:18,993 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:18,993 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 00:56:18,996 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-11 00:56:18,996 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:18,996 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:18,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:18,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:18,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:18,996 DEBUG [member: 'jenkins-hbase4.apache.org,38819,1678496016129' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-11 00:56:18,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:18,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:18,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:18,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:18,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:18,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:18,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:18,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38819,1678496016129': 2023-03-11 00:56:18,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38819,1678496016129' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-11 00:56:18,998 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-11 00:56:18,998 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 00:56:18,998 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 00:56:18,998 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-11 00:56:18,998 INFO [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 00:56:19,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:19,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:19,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:19,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 00:56:19,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 00:56:19,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:19,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:19,000 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:19,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 00:56:19,000 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:19,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:19,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:19,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:19,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:19,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 00:56:19,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:19,002 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:19,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:19,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 00:56:19,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 00:56:19,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:19,004 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:19,004 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 00:56:19,004 DEBUG [(jenkins-hbase4.apache.org,40615,1678496014902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 00:56:19,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-11 00:56:19,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 00:56:19,004 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:19,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 00:56:19,004 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 00:56:19,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-11 00:56:19,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 00:56:19,004 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 00:56:19,004 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:19,004 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:19,004 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 00:56:19,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 00:56:19,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 00:56:19,004 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-11 00:56:19,005 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 00:56:19,004 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 00:56:19,105 DEBUG [Listener at localhost/45619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 00:56:19,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 00:56:19,106 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:56:19,106 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 964d75905ab3241542288e47f2f019e6/family1 is initiating major compaction (all files) 2023-03-11 00:56:19,106 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:56:19,107 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:56:19,108 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 964d75905ab3241542288e47f2f019e6/family1 in testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:19,108 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/39762926c0134dbe8dede5a8a5e654a9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/6107ff01624f48bf80512b5f59e56cfa, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/2c31762bbeab4abf80348d0e24175996, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/4e023361cc204311bf1394a86a4dcdfe, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/ff0e474f1e5c4bb2a08676fb5f7131b9] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp, totalSize=27.1 K 2023-03-11 00:56:19,109 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 39762926c0134dbe8dede5a8a5e654a9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496170014 2023-03-11 00:56:19,109 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 6107ff01624f48bf80512b5f59e56cfa, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496171900 2023-03-11 00:56:19,110 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 2c31762bbeab4abf80348d0e24175996, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496173771 2023-03-11 00:56:19,110 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 4e023361cc204311bf1394a86a4dcdfe, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496175628 2023-03-11 00:56:19,111 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting ff0e474f1e5c4bb2a08676fb5f7131b9, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:56:19,121 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 964d75905ab3241542288e47f2f019e6#family1#compaction#196 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:56:19,563 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303114c24e4e4d1ab4c608153854e60627bfa_del 2023-03-11 00:56:19,563 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303114c24e4e4d1ab4c608153854e60627bfa_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303114c24e4e4d1ab4c608153854e60627bfa_del 2023-03-11 00:56:19,641 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8712c51c419d4ffaa90f6b82e8db217a 2023-03-11 00:56:19,642 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family1/8712c51c419d4ffaa90f6b82e8db217a as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/8712c51c419d4ffaa90f6b82e8db217a 2023-03-11 00:56:19,664 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8712c51c419d4ffaa90f6b82e8db217a 2023-03-11 00:56:19,665 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 964d75905ab3241542288e47f2f019e6/family1 of 964d75905ab3241542288e47f2f019e6 into 8712c51c419d4ffaa90f6b82e8db217a(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:56:19,665 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:19,665 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:56:19,665 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 964d75905ab3241542288e47f2f019e6/family2 is initiating major compaction (all files) 2023-03-11 00:56:19,665 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:56:19,665 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:56:19,667 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 964d75905ab3241542288e47f2f019e6/family2 in testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:19,667 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/7e3a09b7545f4a59b00c27cb1f02daf4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/ab005422ff3848e4a3d645c8d1214713, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/adf2e3acdd6148488c4cc9ad6bc29961, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/85186ad12d65435f8b6fe843c7133d6f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/57e19e568dce4b39bf2762e4a42b59fd] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp, totalSize=25.4 K 2023-03-11 00:56:19,667 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 7e3a09b7545f4a59b00c27cb1f02daf4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496170014 2023-03-11 00:56:19,668 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting ab005422ff3848e4a3d645c8d1214713, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496171900 2023-03-11 00:56:19,668 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting adf2e3acdd6148488c4cc9ad6bc29961, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496173771 2023-03-11 00:56:19,668 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 85186ad12d65435f8b6fe843c7133d6f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496175628 2023-03-11 00:56:19,668 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 57e19e568dce4b39bf2762e4a42b59fd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:56:19,675 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 964d75905ab3241542288e47f2f019e6#family2#compaction#197 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:56:19,684 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303118cae415e1d114869b65e331f362082e4_del 2023-03-11 00:56:19,684 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303118cae415e1d114869b65e331f362082e4_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303118cae415e1d114869b65e331f362082e4_del 2023-03-11 00:56:19,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/39762926c0134dbe8dede5a8a5e654a9, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/6107ff01624f48bf80512b5f59e56cfa, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/2c31762bbeab4abf80348d0e24175996, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/4e023361cc204311bf1394a86a4dcdfe, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/ff0e474f1e5c4bb2a08676fb5f7131b9] to archive 2023-03-11 00:56:19,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:19,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/39762926c0134dbe8dede5a8a5e654a9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/39762926c0134dbe8dede5a8a5e654a9 2023-03-11 00:56:19,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/6107ff01624f48bf80512b5f59e56cfa to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/6107ff01624f48bf80512b5f59e56cfa 2023-03-11 00:56:19,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/2c31762bbeab4abf80348d0e24175996 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/2c31762bbeab4abf80348d0e24175996 2023-03-11 00:56:19,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/4e023361cc204311bf1394a86a4dcdfe to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/4e023361cc204311bf1394a86a4dcdfe 2023-03-11 00:56:19,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/ff0e474f1e5c4bb2a08676fb5f7131b9 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/ff0e474f1e5c4bb2a08676fb5f7131b9 2023-03-11 00:56:19,695 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4713ab8ba1234821873e82fc9ffece78 2023-03-11 00:56:19,696 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/.tmp/family2/4713ab8ba1234821873e82fc9ffece78 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/4713ab8ba1234821873e82fc9ffece78 2023-03-11 00:56:19,698 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4713ab8ba1234821873e82fc9ffece78 2023-03-11 00:56:19,699 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 964d75905ab3241542288e47f2f019e6/family2 of 964d75905ab3241542288e47f2f019e6 into 4713ab8ba1234821873e82fc9ffece78(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:56:19,699 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:19,699 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:56:19,700 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 8fb50c17bb27da3d117b029e4948fcca/family1 is initiating major compaction (all files) 2023-03-11 00:56:19,700 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:56:19,700 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:56:19,700 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 8fb50c17bb27da3d117b029e4948fcca/family1 in testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:19,700 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/f34d0645e4bf403fbfbc9f919276fc23, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/b8e6237c0e7542cfa78b5857eed294fa, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/c425a86cb6214826b6a256bd59e25d4f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/77e2c435a4bc41eebc840f42491d0d7d, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/d0c734ee62c14c288df3210065a40953] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp, totalSize=27.1 K 2023-03-11 00:56:19,701 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting f34d0645e4bf403fbfbc9f919276fc23, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496170014 2023-03-11 00:56:19,701 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting b8e6237c0e7542cfa78b5857eed294fa, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496171900 2023-03-11 00:56:19,701 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting c425a86cb6214826b6a256bd59e25d4f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496173771 2023-03-11 00:56:19,701 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 77e2c435a4bc41eebc840f42491d0d7d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496175627 2023-03-11 00:56:19,702 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting d0c734ee62c14c288df3210065a40953, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:56:19,709 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 8fb50c17bb27da3d117b029e4948fcca#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:56:19,751 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303113d3c2c4515b14323aa0ac819d776a178_del 2023-03-11 00:56:19,751 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303113d3c2c4515b14323aa0ac819d776a178_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303113d3c2c4515b14323aa0ac819d776a178_del 2023-03-11 00:56:19,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/7e3a09b7545f4a59b00c27cb1f02daf4, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/ab005422ff3848e4a3d645c8d1214713, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/adf2e3acdd6148488c4cc9ad6bc29961, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/85186ad12d65435f8b6fe843c7133d6f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/57e19e568dce4b39bf2762e4a42b59fd] to archive 2023-03-11 00:56:19,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:19,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/7e3a09b7545f4a59b00c27cb1f02daf4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/7e3a09b7545f4a59b00c27cb1f02daf4 2023-03-11 00:56:19,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/ab005422ff3848e4a3d645c8d1214713 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/ab005422ff3848e4a3d645c8d1214713 2023-03-11 00:56:19,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/adf2e3acdd6148488c4cc9ad6bc29961 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/adf2e3acdd6148488c4cc9ad6bc29961 2023-03-11 00:56:19,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/85186ad12d65435f8b6fe843c7133d6f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/85186ad12d65435f8b6fe843c7133d6f 2023-03-11 00:56:19,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/57e19e568dce4b39bf2762e4a42b59fd to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family2/57e19e568dce4b39bf2762e4a42b59fd 2023-03-11 00:56:20,601 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9237c9162fa4452e907bdd6867c25c7a 2023-03-11 00:56:20,602 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family1/9237c9162fa4452e907bdd6867c25c7a as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/9237c9162fa4452e907bdd6867c25c7a 2023-03-11 00:56:20,622 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9237c9162fa4452e907bdd6867c25c7a 2023-03-11 00:56:20,623 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8fb50c17bb27da3d117b029e4948fcca/family1 of 8fb50c17bb27da3d117b029e4948fcca into 9237c9162fa4452e907bdd6867c25c7a(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:56:20,623 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:20,623 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:56:20,623 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 8fb50c17bb27da3d117b029e4948fcca/family2 is initiating major compaction (all files) 2023-03-11 00:56:20,623 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:56:20,624 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:56:20,624 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 8fb50c17bb27da3d117b029e4948fcca/family2 in testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:20,624 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/67deeff31cc04d3bba7a1e199f68dd2e, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/3789e091e753480bad1c7fe127d77313, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/7a49e38e42cf47e9bd61d8a308017631, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/9b5845deb7e549faa5df53e22e650e33, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/8f8dc511fabb4a978735bf8632c1ca89] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp, totalSize=25.4 K 2023-03-11 00:56:20,624 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 67deeff31cc04d3bba7a1e199f68dd2e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496170014 2023-03-11 00:56:20,624 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 3789e091e753480bad1c7fe127d77313, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496171900 2023-03-11 00:56:20,625 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 7a49e38e42cf47e9bd61d8a308017631, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496173771 2023-03-11 00:56:20,625 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 9b5845deb7e549faa5df53e22e650e33, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496175627 2023-03-11 00:56:20,625 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 8f8dc511fabb4a978735bf8632c1ca89, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:56:20,631 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 8fb50c17bb27da3d117b029e4948fcca#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:56:20,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/f34d0645e4bf403fbfbc9f919276fc23, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/b8e6237c0e7542cfa78b5857eed294fa, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/c425a86cb6214826b6a256bd59e25d4f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/77e2c435a4bc41eebc840f42491d0d7d, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/d0c734ee62c14c288df3210065a40953] to archive 2023-03-11 00:56:20,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:20,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/f34d0645e4bf403fbfbc9f919276fc23 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/f34d0645e4bf403fbfbc9f919276fc23 2023-03-11 00:56:20,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/b8e6237c0e7542cfa78b5857eed294fa to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/b8e6237c0e7542cfa78b5857eed294fa 2023-03-11 00:56:20,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/c425a86cb6214826b6a256bd59e25d4f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/c425a86cb6214826b6a256bd59e25d4f 2023-03-11 00:56:20,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/77e2c435a4bc41eebc840f42491d0d7d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/77e2c435a4bc41eebc840f42491d0d7d 2023-03-11 00:56:20,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/d0c734ee62c14c288df3210065a40953 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/d0c734ee62c14c288df3210065a40953 2023-03-11 00:56:21,038 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230311e86046a60c064e3bb90eda27c91a52b7_del 2023-03-11 00:56:21,038 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311e86046a60c064e3bb90eda27c91a52b7_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230311e86046a60c064e3bb90eda27c91a52b7_del 2023-03-11 00:56:21,850 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 443ce94af0e14f278d02f1ec1cd296b5 2023-03-11 00:56:21,851 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/.tmp/family2/443ce94af0e14f278d02f1ec1cd296b5 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/443ce94af0e14f278d02f1ec1cd296b5 2023-03-11 00:56:21,855 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 443ce94af0e14f278d02f1ec1cd296b5 2023-03-11 00:56:21,855 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8fb50c17bb27da3d117b029e4948fcca/family2 of 8fb50c17bb27da3d117b029e4948fcca into 443ce94af0e14f278d02f1ec1cd296b5(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 00:56:21,856 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:21,856 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:56:21,856 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 3117f002e6ad4ea015cd6759edd92f71/family1 is initiating major compaction (all files) 2023-03-11 00:56:21,856 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:56:21,856 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:56:21,856 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 3117f002e6ad4ea015cd6759edd92f71/family1 in testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:21,856 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/5190a35d032e4237a163d4bb1798725b, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/a89441c3f5274e8a9a055bf8f745ad5f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/d98f4fafc8854b38bd1d609329ea58fe, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/610d1cf101d74c93ae96d5de79c3cbcf, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/1b870645a1e34eec9da8040db190eace] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp, totalSize=27.1 K 2023-03-11 00:56:21,857 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 5190a35d032e4237a163d4bb1798725b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496170014 2023-03-11 00:56:21,857 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting a89441c3f5274e8a9a055bf8f745ad5f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496171900 2023-03-11 00:56:21,858 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting d98f4fafc8854b38bd1d609329ea58fe, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496173771 2023-03-11 00:56:21,858 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 610d1cf101d74c93ae96d5de79c3cbcf, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496175628 2023-03-11 00:56:21,858 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 1b870645a1e34eec9da8040db190eace, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:56:21,865 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 3117f002e6ad4ea015cd6759edd92f71#family1#compaction#200 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:56:21,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/67deeff31cc04d3bba7a1e199f68dd2e, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/3789e091e753480bad1c7fe127d77313, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/7a49e38e42cf47e9bd61d8a308017631, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/9b5845deb7e549faa5df53e22e650e33, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/8f8dc511fabb4a978735bf8632c1ca89] to archive 2023-03-11 00:56:21,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:21,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/67deeff31cc04d3bba7a1e199f68dd2e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/67deeff31cc04d3bba7a1e199f68dd2e 2023-03-11 00:56:21,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/3789e091e753480bad1c7fe127d77313 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/3789e091e753480bad1c7fe127d77313 2023-03-11 00:56:21,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/7a49e38e42cf47e9bd61d8a308017631 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/7a49e38e42cf47e9bd61d8a308017631 2023-03-11 00:56:21,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/9b5845deb7e549faa5df53e22e650e33 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/9b5845deb7e549faa5df53e22e650e33 2023-03-11 00:56:21,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/8f8dc511fabb4a978735bf8632c1ca89 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family2/8f8dc511fabb4a978735bf8632c1ca89 2023-03-11 00:56:22,301 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230311d912905ff9214d169182bb4d69d21998_del 2023-03-11 00:56:22,301 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311d912905ff9214d169182bb4d69d21998_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311d912905ff9214d169182bb4d69d21998_del 2023-03-11 00:56:22,751 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9973ce6ec734d04b43c50c9bb1778e2 2023-03-11 00:56:22,751 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family1/e9973ce6ec734d04b43c50c9bb1778e2 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/e9973ce6ec734d04b43c50c9bb1778e2 2023-03-11 00:56:22,772 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9973ce6ec734d04b43c50c9bb1778e2 2023-03-11 00:56:22,773 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3117f002e6ad4ea015cd6759edd92f71/family1 of 3117f002e6ad4ea015cd6759edd92f71 into e9973ce6ec734d04b43c50c9bb1778e2(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:56:22,773 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:22,773 DEBUG [Listener at localhost/45619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 00:56:22,773 DEBUG [Listener at localhost/45619] regionserver.HStore(1912): 3117f002e6ad4ea015cd6759edd92f71/family2 is initiating major compaction (all files) 2023-03-11 00:56:22,774 INFO [Listener at localhost/45619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 00:56:22,774 INFO [Listener at localhost/45619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 00:56:22,774 INFO [Listener at localhost/45619] regionserver.HRegion(2259): Starting compaction of 3117f002e6ad4ea015cd6759edd92f71/family2 in testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:22,774 INFO [Listener at localhost/45619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/74e475c834b446699dbeebcb3223959f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/13a0d340883c4296b048cf307d1fdf90, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/8fe6a441fd184058a43a1c42edde8bd3, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/da43974efd744a3cb6f4754287d43b4f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/dd46b37b2f69455abcf7082203604514] into tmpdir=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp, totalSize=25.4 K 2023-03-11 00:56:22,774 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 74e475c834b446699dbeebcb3223959f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678496170014 2023-03-11 00:56:22,775 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 13a0d340883c4296b048cf307d1fdf90, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678496171900 2023-03-11 00:56:22,775 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting 8fe6a441fd184058a43a1c42edde8bd3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678496173771 2023-03-11 00:56:22,775 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting da43974efd744a3cb6f4754287d43b4f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678496175628 2023-03-11 00:56:22,776 DEBUG [Listener at localhost/45619] compactions.Compactor(207): Compacting dd46b37b2f69455abcf7082203604514, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 00:56:22,783 INFO [Listener at localhost/45619] throttle.PressureAwareThroughputController(145): 3117f002e6ad4ea015cd6759edd92f71#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 00:56:22,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/5190a35d032e4237a163d4bb1798725b, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/a89441c3f5274e8a9a055bf8f745ad5f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/d98f4fafc8854b38bd1d609329ea58fe, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/610d1cf101d74c93ae96d5de79c3cbcf, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/1b870645a1e34eec9da8040db190eace] to archive 2023-03-11 00:56:22,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:22,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/5190a35d032e4237a163d4bb1798725b to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/5190a35d032e4237a163d4bb1798725b 2023-03-11 00:56:22,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/a89441c3f5274e8a9a055bf8f745ad5f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/a89441c3f5274e8a9a055bf8f745ad5f 2023-03-11 00:56:22,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/d98f4fafc8854b38bd1d609329ea58fe to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/d98f4fafc8854b38bd1d609329ea58fe 2023-03-11 00:56:22,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/610d1cf101d74c93ae96d5de79c3cbcf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/610d1cf101d74c93ae96d5de79c3cbcf 2023-03-11 00:56:22,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/1b870645a1e34eec9da8040db190eace to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/1b870645a1e34eec9da8040db190eace 2023-03-11 00:56:23,190 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303111b35b77e9a4d4ec092833f7a590bdc00_del 2023-03-11 00:56:23,191 INFO [Listener at localhost/45619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303111b35b77e9a4d4ec092833f7a590bdc00_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303111b35b77e9a4d4ec092833f7a590bdc00_del 2023-03-11 00:56:23,603 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fbe08a97f6a48afb5137ca876d14f64 2023-03-11 00:56:23,604 DEBUG [Listener at localhost/45619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/.tmp/family2/6fbe08a97f6a48afb5137ca876d14f64 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/6fbe08a97f6a48afb5137ca876d14f64 2023-03-11 00:56:23,608 INFO [Listener at localhost/45619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fbe08a97f6a48afb5137ca876d14f64 2023-03-11 00:56:23,609 INFO [Listener at localhost/45619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3117f002e6ad4ea015cd6759edd92f71/family2 of 3117f002e6ad4ea015cd6759edd92f71 into 6fbe08a97f6a48afb5137ca876d14f64(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 00:56:23,609 DEBUG [Listener at localhost/45619] regionserver.HRegion(2289): Compaction status journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:23,613 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:56:23,616 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:56:23,619 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:56:23,619 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:56:23,623 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40615] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xD3\xBDY\x8C+\x80\xF4\xBB]\x0DK7\x9D\xA3\xA2\xAB"\x106\x13\x17\xC3\xBD6M\x92\x1EL\xDB\x9A\x9EU\x0B\xD9*\x10\xF6\x15\xC0\x5C\xA3\xB4\x0A0o\xE2\xD809\x02\x06{2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-11 00:56:23,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-11 00:56:23,645 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-11 00:56:23,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:56:23,645 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678496783645 2023-03-11 00:56:23,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 00:56:23,679 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:56:23,679 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x149e6bd6 to 127.0.0.1:62412 2023-03-11 00:56:23,679 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:56:23,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/74e475c834b446699dbeebcb3223959f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/13a0d340883c4296b048cf307d1fdf90, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/8fe6a441fd184058a43a1c42edde8bd3, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/da43974efd744a3cb6f4754287d43b4f, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/dd46b37b2f69455abcf7082203604514] to archive 2023-03-11 00:56:23,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:23,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/74e475c834b446699dbeebcb3223959f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/74e475c834b446699dbeebcb3223959f 2023-03-11 00:56:23,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/13a0d340883c4296b048cf307d1fdf90 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/13a0d340883c4296b048cf307d1fdf90 2023-03-11 00:56:23,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/8fe6a441fd184058a43a1c42edde8bd3 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/8fe6a441fd184058a43a1c42edde8bd3 2023-03-11 00:56:23,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/da43974efd744a3cb6f4754287d43b4f to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/da43974efd744a3cb6f4754287d43b4f 2023-03-11 00:56:23,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/dd46b37b2f69455abcf7082203604514 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family2/dd46b37b2f69455abcf7082203604514 2023-03-11 00:56:23,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-11 00:56:23,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303113d3c2c4515b14323aa0ac819d776a178_del 2023-03-11 00:56:24,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303114c24e4e4d1ab4c608153854e60627bfa_del 2023-03-11 00:56:24,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230311d912905ff9214d169182bb4d69d21998_del 2023-03-11 00:56:24,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 00:56:24,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] zookeeper.ReadOnlyZKClient(139): Connect 0x43b8d6a8 to 127.0.0.1:62412 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 00:56:24,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@279a05e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 00:56:24,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 00:56:24,990 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303117bb80697f3b641bd93b0b888b6e49f27 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303117bb80697f3b641bd93b0b888b6e49f27 2023-03-11 00:56:24,991 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 00:56:25,001 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 00:56:25,004 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37332, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 00:56:25,011 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 00:56:25,013 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52620, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 00:56:25,039 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230311/family1/1c5c7c9b269a49a9a5cfa0f4528688de first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-11 00:56:25,039 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230311/family1/1c5c7c9b269a49a9a5cfa0f4528688de}] 2023-03-11 00:56:25,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230311/family1/1c5c7c9b269a49a9a5cfa0f4528688de for inclusion in 964d75905ab3241542288e47f2f019e6/family1 2023-03-11 00:56:25,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-11 00:56:25,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-11 00:56:25,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:25,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230311/family1/1c5c7c9b269a49a9a5cfa0f4528688de to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__svfh3mgmdu5p4mi3itoelubvrl6tt13d0bkbddkssq2tdae2kv80cbtghb1gh10j/family1/1c5c7c9b269a49a9a5cfa0f4528688de 2023-03-11 00:56:25,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__svfh3mgmdu5p4mi3itoelubvrl6tt13d0bkbddkssq2tdae2kv80cbtghb1gh10j/family1/1c5c7c9b269a49a9a5cfa0f4528688de as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/d40ce7dd82744ec1b610e0c6451e2114_SeqId_28_ 2023-03-11 00:56:25,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__svfh3mgmdu5p4mi3itoelubvrl6tt13d0bkbddkssq2tdae2kv80cbtghb1gh10j/family1/1c5c7c9b269a49a9a5cfa0f4528688de into 964d75905ab3241542288e47f2f019e6/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/d40ce7dd82744ec1b610e0c6451e2114_SeqId_28_ - updating store file list. 2023-03-11 00:56:25,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/d40ce7dd82744ec1b610e0c6451e2114_SeqId_28_ into 964d75905ab3241542288e47f2f019e6/family1 2023-03-11 00:56:25,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__svfh3mgmdu5p4mi3itoelubvrl6tt13d0bkbddkssq2tdae2kv80cbtghb1gh10j/family1/1c5c7c9b269a49a9a5cfa0f4528688de into 964d75905ab3241542288e47f2f019e6/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/family1/d40ce7dd82744ec1b610e0c6451e2114_SeqId_28_) 2023-03-11 00:56:25,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__svfh3mgmdu5p4mi3itoelubvrl6tt13d0bkbddkssq2tdae2kv80cbtghb1gh10j/family1/1c5c7c9b269a49a9a5cfa0f4528688de 2023-03-11 00:56:25,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 00:56:25,089 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:25,091 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031161fb714cd1104bdd8f1ab4dfc3ac66cf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031161fb714cd1104bdd8f1ab4dfc3ac66cf 2023-03-11 00:56:25,091 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311a653caf2fa1f4bc2ab01714f349cf2d2 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311a653caf2fa1f4bc2ab01714f349cf2d2 2023-03-11 00:56:25,092 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311d676395f44e44450a98d7cc888e5e806 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311d676395f44e44450a98d7cc888e5e806 2023-03-11 00:56:25,093 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311e4ce15b22c8a420bb1a7addfc1aa375d to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311e4ce15b22c8a420bb1a7addfc1aa375d 2023-03-11 00:56:25,093 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-11 00:56:25,093 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230311' 2023-03-11 00:56:25,093 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 00:56:25,093 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 00:56:26,066 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303113a0df8a63bde43ce85ace708dfae97d8 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303113a0df8a63bde43ce85ace708dfae97d8 2023-03-11 00:56:26,067 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 00:56:26,103 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-11 00:56:26,115 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230311/family1/1cebdc43a044436d83d737f5e1c1baf4 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-11 00:56:26,116 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230311/family1/1cebdc43a044436d83d737f5e1c1baf4}] 2023-03-11 00:56:26,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230311/family1/1cebdc43a044436d83d737f5e1c1baf4 for inclusion in 3117f002e6ad4ea015cd6759edd92f71/family1 2023-03-11 00:56:26,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-11 00:56:26,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-11 00:56:26,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:26,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230311/family1/1cebdc43a044436d83d737f5e1c1baf4 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__7143rcmnaboa1tfko1q0q1vt9dvjmq3vprb0rm9lrb5ncv1nnr9qifu45mu1rnlc/family1/1cebdc43a044436d83d737f5e1c1baf4 2023-03-11 00:56:26,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__7143rcmnaboa1tfko1q0q1vt9dvjmq3vprb0rm9lrb5ncv1nnr9qifu45mu1rnlc/family1/1cebdc43a044436d83d737f5e1c1baf4 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/3013b148732d4f72bf72554a0120fa9f_SeqId_28_ 2023-03-11 00:56:26,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__7143rcmnaboa1tfko1q0q1vt9dvjmq3vprb0rm9lrb5ncv1nnr9qifu45mu1rnlc/family1/1cebdc43a044436d83d737f5e1c1baf4 into 3117f002e6ad4ea015cd6759edd92f71/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/3013b148732d4f72bf72554a0120fa9f_SeqId_28_ - updating store file list. 2023-03-11 00:56:26,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/3013b148732d4f72bf72554a0120fa9f_SeqId_28_ into 3117f002e6ad4ea015cd6759edd92f71/family1 2023-03-11 00:56:26,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__7143rcmnaboa1tfko1q0q1vt9dvjmq3vprb0rm9lrb5ncv1nnr9qifu45mu1rnlc/family1/1cebdc43a044436d83d737f5e1c1baf4 into 3117f002e6ad4ea015cd6759edd92f71/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/family1/3013b148732d4f72bf72554a0120fa9f_SeqId_28_) 2023-03-11 00:56:26,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__7143rcmnaboa1tfko1q0q1vt9dvjmq3vprb0rm9lrb5ncv1nnr9qifu45mu1rnlc/family1/1cebdc43a044436d83d737f5e1c1baf4 2023-03-11 00:56:26,179 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 00:56:26,179 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:26,181 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311035480f7c3004a49b8919aee14b84abe to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311035480f7c3004a49b8919aee14b84abe 2023-03-11 00:56:26,181 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311232a45899ce94c528774d731858661cd to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311232a45899ce94c528774d731858661cd 2023-03-11 00:56:26,182 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311390c96ba6bb340b0b75002b8b1c5e9bf to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311390c96ba6bb340b0b75002b8b1c5e9bf 2023-03-11 00:56:26,184 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311a4ae8d4cd5864f5094f939ad936bff6e to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311a4ae8d4cd5864f5094f939ad936bff6e 2023-03-11 00:56:26,184 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-11 00:56:26,184 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230311' 2023-03-11 00:56:26,184 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 00:56:26,184 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 00:56:26,786 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303116d5083147c834ec5a997626fdfaeb615 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303116d5083147c834ec5a997626fdfaeb615 2023-03-11 00:56:26,788 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 00:56:26,844 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230311/family1/ff56dc112718440bace0531baa643fd5 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-11 00:56:26,845 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca., hostname=jenkins-hbase4.apache.org,38819,1678496016129, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230311/family1/ff56dc112718440bace0531baa643fd5}] 2023-03-11 00:56:26,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(763): Validating hfile at hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230311/family1/ff56dc112718440bace0531baa643fd5 for inclusion in 8fb50c17bb27da3d117b029e4948fcca/family1 2023-03-11 00:56:26,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-11 00:56:26,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(777): Region bounds: first= last=1 2023-03-11 00:56:26,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegion(2446): Flush status journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:26,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230311/family1/ff56dc112718440bace0531baa643fd5 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__1t5uum61gnqri9qe8jqtraoe8mc0kvq63vjggpt5u970q3aqakftldggrenabeqb/family1/ff56dc112718440bace0531baa643fd5 2023-03-11 00:56:26,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__1t5uum61gnqri9qe8jqtraoe8mc0kvq63vjggpt5u970q3aqakftldggrenabeqb/family1/ff56dc112718440bace0531baa643fd5 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/d5e65329ab6b456fb6e21e56591ab9f3_SeqId_28_ 2023-03-11 00:56:26,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(849): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__1t5uum61gnqri9qe8jqtraoe8mc0kvq63vjggpt5u970q3aqakftldggrenabeqb/family1/ff56dc112718440bace0531baa643fd5 into 8fb50c17bb27da3d117b029e4948fcca/family1 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/d5e65329ab6b456fb6e21e56591ab9f3_SeqId_28_ - updating store file list. 2023-03-11 00:56:26,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(882): Loaded HFile hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/d5e65329ab6b456fb6e21e56591ab9f3_SeqId_28_ into 8fb50c17bb27da3d117b029e4948fcca/family1 2023-03-11 00:56:26,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.HStore(855): Successfully loaded hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__1t5uum61gnqri9qe8jqtraoe8mc0kvq63vjggpt5u970q3aqakftldggrenabeqb/family1/ff56dc112718440bace0531baa643fd5 into 8fb50c17bb27da3d117b029e4948fcca/family1 (new location: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/family1/d5e65329ab6b456fb6e21e56591ab9f3_SeqId_28_) 2023-03-11 00:56:26,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38819] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/staging/jenkins__testMajorCompactionFromAdmin__1t5uum61gnqri9qe8jqtraoe8mc0kvq63vjggpt5u970q3aqakftldggrenabeqb/family1/ff56dc112718440bace0531baa643fd5 2023-03-11 00:56:26,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 00:56:26,921 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:26,922 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311194839c697d844b4a76eaddb08505938 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311194839c697d844b4a76eaddb08505938 2023-03-11 00:56:26,923 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311828a45b3a4e94a37a43b1350c2f31665 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311828a45b3a4e94a37a43b1350c2f31665 2023-03-11 00:56:26,925 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311885d3a31ab9f41bb81ad9fdafd591330 to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311885d3a31ab9f41bb81ad9fdafd591330 2023-03-11 00:56:26,926 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311c693721886bd460ea5a048eb981073ca to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311c693721886bd460ea5a048eb981073ca 2023-03-11 00:56:26,926 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-11 00:56:26,926 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230311' 2023-03-11 00:56:26,928 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 00:56:26,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 00:56:26,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 00:56:26,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303113d3c2c4515b14323aa0ac819d776a178_del] 2023-03-11 00:56:26,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:26,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303113d3c2c4515b14323aa0ac819d776a178_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303113d3c2c4515b14323aa0ac819d776a178_del 2023-03-11 00:56:26,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-11 00:56:26,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303114c24e4e4d1ab4c608153854e60627bfa_del] 2023-03-11 00:56:26,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:26,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303114c24e4e4d1ab4c608153854e60627bfa_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303114c24e4e4d1ab4c608153854e60627bfa_del 2023-03-11 00:56:26,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-11 00:56:26,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311d912905ff9214d169182bb4d69d21998_del] 2023-03-11 00:56:26,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 00:56:26,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311d912905ff9214d169182bb4d69d21998_del to hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311d912905ff9214d169182bb4d69d21998_del 2023-03-11 00:56:26,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-11 00:56:26,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678496019155] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 00:56:26,939 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-11 00:56:26,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.2960 sec 2023-03-11 00:56:26,962 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:56:26,964 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:56:26,966 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 00:56:26,967 DEBUG [Listener at localhost/45619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 00:56:26,971 INFO [Listener at localhost/45619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 00:56:27,020 INFO [Listener at localhost/45619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=248 (was 258), OpenFileDescriptor=635 (was 643), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=222 (was 187) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=5134 (was 5359) 2023-03-11 00:56:27,020 DEBUG [Listener at localhost/45619] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33fc1e18 to 127.0.0.1:62412 2023-03-11 00:56:27,021 DEBUG [Listener at localhost/45619] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:56:27,021 INFO [Listener at localhost/45619] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-11 00:56:27,021 INFO [Listener at localhost/45619] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 00:56:27,021 DEBUG [Listener at localhost/45619] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0672b468 to 127.0.0.1:62412 2023-03-11 00:56:27,021 DEBUG [Listener at localhost/45619] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:56:27,021 DEBUG [Listener at localhost/45619] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-11 00:56:27,022 DEBUG [Listener at localhost/45619] util.JVMClusterUtil(257): Found active master hash=1257259383, stopped=false 2023-03-11 00:56:27,022 INFO [Listener at localhost/45619] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40615,1678496014902 2023-03-11 00:56:27,024 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-11 00:56:27,024 INFO [Listener at localhost/45619] procedure2.ProcedureExecutor(629): Stopping 2023-03-11 00:56:27,024 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-11 00:56:27,025 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 00:56:27,025 DEBUG [Listener at localhost/45619] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x472ce7e8 to 127.0.0.1:62412 2023-03-11 00:56:27,025 DEBUG [Listener at localhost/45619] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:56:27,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-11 00:56:27,025 INFO [Listener at localhost/45619] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38819,1678496016129' ***** 2023-03-11 00:56:27,025 INFO [Listener at localhost/45619] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-11 00:56:27,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-11 00:56:27,025 INFO [RS:0;jenkins-hbase4:38819] regionserver.HeapMemoryManager(220): Stopping 2023-03-11 00:56:27,026 INFO [RS:0;jenkins-hbase4:38819] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-11 00:56:27,026 INFO [RS:0;jenkins-hbase4:38819] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-11 00:56:27,026 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-11 00:56:27,026 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 2821f2e121861947edb0825c770e8e9f 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for ed94f2cc321958ef391106e73bef4663 2023-03-11 00:56:27,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2821f2e121861947edb0825c770e8e9f, disabling compactions & flushes 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 188d034f375c424808618086c37597ed 2023-03-11 00:56:27,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 080973ca19275505e5727ec713c114b9 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for d4d84b511dc532e521aa954b19da2872 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 19f6bc8c94651102c50eaacf1b54c002 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 186abf08f502dabd8577259d44f7d8d9 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 439fc7d2553cd76c08e8dd28cd3ba7b6 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 964d75905ab3241542288e47f2f019e6 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 2b37f493ceeadf41ebe7d2e9f0d628c2 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 78c948ce5e0a1cdee67cd729e4b6b9db 2023-03-11 00:56:27,027 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 8fb50c17bb27da3d117b029e4948fcca 2023-03-11 00:56:27,028 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 36cfe1c0fa36465e8e4065cb6f4feb3e 2023-03-11 00:56:27,028 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 2dd70ffc836295255740f79f024e3511 2023-03-11 00:56:27,028 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 327735cd40a8e23c9c8cdf4047ec37a3 2023-03-11 00:56:27,028 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 053e1f32f2dd2afeb0e5696a70cb7982 2023-03-11 00:56:27,028 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 3117f002e6ad4ea015cd6759edd92f71 2023-03-11 00:56:27,028 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 6f70d0cb8cdfe50a22b0232bd3d5c5b9 2023-03-11 00:56:27,028 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 1e8871741be4163356575157eead69a3 2023-03-11 00:56:27,028 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:27,028 DEBUG [RS:0;jenkins-hbase4:38819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f0b533f to 127.0.0.1:62412 2023-03-11 00:56:27,028 DEBUG [RS:0;jenkins-hbase4:38819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:56:27,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:56:27,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. after waiting 0 ms 2023-03-11 00:56:27,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:56:27,030 INFO [RS:0;jenkins-hbase4:38819] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-11 00:56:27,030 INFO [RS:0;jenkins-hbase4:38819] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-11 00:56:27,030 INFO [RS:0;jenkins-hbase4:38819] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-11 00:56:27,030 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-11 00:56:27,031 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-11 00:56:27,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-11 00:56:27,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-11 00:56:27,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-11 00:56:27,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-11 00:56:27,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-11 00:56:27,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-03-11 00:56:27,031 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1505): Waiting on 053e1f32f2dd2afeb0e5696a70cb7982, 080973ca19275505e5727ec713c114b9, 1588230740, 186abf08f502dabd8577259d44f7d8d9, 188d034f375c424808618086c37597ed, 19f6bc8c94651102c50eaacf1b54c002, 1e8871741be4163356575157eead69a3, 2821f2e121861947edb0825c770e8e9f, 2b37f493ceeadf41ebe7d2e9f0d628c2, 2dd70ffc836295255740f79f024e3511, 3117f002e6ad4ea015cd6759edd92f71, 327735cd40a8e23c9c8cdf4047ec37a3, 36cfe1c0fa36465e8e4065cb6f4feb3e, 439fc7d2553cd76c08e8dd28cd3ba7b6, 6f70d0cb8cdfe50a22b0232bd3d5c5b9, 78c948ce5e0a1cdee67cd729e4b6b9db, 8fb50c17bb27da3d117b029e4948fcca, 964d75905ab3241542288e47f2f019e6, 9f98d24cb38e778755e7bb1a46a77261, d4d84b511dc532e521aa954b19da2872, ed94f2cc321958ef391106e73bef4663 2023-03-11 00:56:27,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/2821f2e121861947edb0825c770e8e9f/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-11 00:56:27,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:56:27,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2821f2e121861947edb0825c770e8e9f: 2023-03-11 00:56:27,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678496075109.2821f2e121861947edb0825c770e8e9f. 2023-03-11 00:56:27,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ed94f2cc321958ef391106e73bef4663, disabling compactions & flushes 2023-03-11 00:56:27,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:27,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:27,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. after waiting 0 ms 2023-03-11 00:56:27,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:27,041 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-11 00:56:27,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithMonthlyPolicy/ed94f2cc321958ef391106e73bef4663/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-11 00:56:27,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:27,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ed94f2cc321958ef391106e73bef4663: 2023-03-11 00:56:27,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1678496157279.ed94f2cc321958ef391106e73bef4663. 2023-03-11 00:56:27,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 188d034f375c424808618086c37597ed, disabling compactions & flushes 2023-03-11 00:56:27,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:56:27,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:56:27,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. after waiting 0 ms 2023-03-11 00:56:27,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:56:27,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithMonthlyPolicy/188d034f375c424808618086c37597ed/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-11 00:56:27,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:56:27,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 188d034f375c424808618086c37597ed: 2023-03-11 00:56:27,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1678496033879.188d034f375c424808618086c37597ed. 2023-03-11 00:56:27,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 080973ca19275505e5727ec713c114b9, disabling compactions & flushes 2023-03-11 00:56:27,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:56:27,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:56:27,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. after waiting 0 ms 2023-03-11 00:56:27,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:56:27,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/080973ca19275505e5727ec713c114b9/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-11 00:56:27,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:56:27,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 080973ca19275505e5727ec713c114b9: 2023-03-11 00:56:27,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678496090981.080973ca19275505e5727ec713c114b9. 2023-03-11 00:56:27,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d4d84b511dc532e521aa954b19da2872, disabling compactions & flushes 2023-03-11 00:56:27,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:56:27,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:56:27,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. after waiting 0 ms 2023-03-11 00:56:27,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:56:27,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/d4d84b511dc532e521aa954b19da2872/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 00:56:27,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:56:27,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d4d84b511dc532e521aa954b19da2872: 2023-03-11 00:56:27,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1678496139004.d4d84b511dc532e521aa954b19da2872. 2023-03-11 00:56:27,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 19f6bc8c94651102c50eaacf1b54c002, disabling compactions & flushes 2023-03-11 00:56:27,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:56:27,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:56:27,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. after waiting 0 ms 2023-03-11 00:56:27,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:56:27,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/19f6bc8c94651102c50eaacf1b54c002/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-11 00:56:27,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:56:27,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 19f6bc8c94651102c50eaacf1b54c002: 2023-03-11 00:56:27,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1678496057623.19f6bc8c94651102c50eaacf1b54c002. 2023-03-11 00:56:27,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 186abf08f502dabd8577259d44f7d8d9, disabling compactions & flushes 2023-03-11 00:56:27,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:56:27,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:56:27,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. after waiting 0 ms 2023-03-11 00:56:27,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:56:27,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/186abf08f502dabd8577259d44f7d8d9/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-11 00:56:27,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:56:27,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 186abf08f502dabd8577259d44f7d8d9: 2023-03-11 00:56:27,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1678496113141.186abf08f502dabd8577259d44f7d8d9. 2023-03-11 00:56:27,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 439fc7d2553cd76c08e8dd28cd3ba7b6, disabling compactions & flushes 2023-03-11 00:56:27,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:56:27,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:56:27,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. after waiting 0 ms 2023-03-11 00:56:27,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:56:27,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/439fc7d2553cd76c08e8dd28cd3ba7b6/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 00:56:27,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:56:27,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 439fc7d2553cd76c08e8dd28cd3ba7b6: 2023-03-11 00:56:27,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1678496139004.439fc7d2553cd76c08e8dd28cd3ba7b6. 2023-03-11 00:56:27,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 964d75905ab3241542288e47f2f019e6, disabling compactions & flushes 2023-03-11 00:56:27,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:27,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:27,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. after waiting 0 ms 2023-03-11 00:56:27,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:27,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/964d75905ab3241542288e47f2f019e6/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 00:56:27,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:27,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 964d75905ab3241542288e47f2f019e6: 2023-03-11 00:56:27,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1678496168872.964d75905ab3241542288e47f2f019e6. 2023-03-11 00:56:27,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2b37f493ceeadf41ebe7d2e9f0d628c2, disabling compactions & flushes 2023-03-11 00:56:27,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:56:27,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:56:27,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. after waiting 0 ms 2023-03-11 00:56:27,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:56:27,084 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-11 00:56:27,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/2b37f493ceeadf41ebe7d2e9f0d628c2/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-11 00:56:27,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:56:27,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2b37f493ceeadf41ebe7d2e9f0d628c2: 2023-03-11 00:56:27,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1678496057623.2b37f493ceeadf41ebe7d2e9f0d628c2. 2023-03-11 00:56:27,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f98d24cb38e778755e7bb1a46a77261, disabling compactions & flushes 2023-03-11 00:56:27,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:56:27,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:56:27,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. after waiting 0 ms 2023-03-11 00:56:27,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:56:27,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9f98d24cb38e778755e7bb1a46a77261 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-11 00:56:27,232 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1505): Waiting on 053e1f32f2dd2afeb0e5696a70cb7982, 1588230740, 1e8871741be4163356575157eead69a3, 2dd70ffc836295255740f79f024e3511, 3117f002e6ad4ea015cd6759edd92f71, 327735cd40a8e23c9c8cdf4047ec37a3, 36cfe1c0fa36465e8e4065cb6f4feb3e, 6f70d0cb8cdfe50a22b0232bd3d5c5b9, 78c948ce5e0a1cdee67cd729e4b6b9db, 8fb50c17bb27da3d117b029e4948fcca, 9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:56:27,351 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-11 00:56:27,432 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1505): Waiting on 053e1f32f2dd2afeb0e5696a70cb7982, 1588230740, 1e8871741be4163356575157eead69a3, 2dd70ffc836295255740f79f024e3511, 3117f002e6ad4ea015cd6759edd92f71, 327735cd40a8e23c9c8cdf4047ec37a3, 36cfe1c0fa36465e8e4065cb6f4feb3e, 6f70d0cb8cdfe50a22b0232bd3d5c5b9, 78c948ce5e0a1cdee67cd729e4b6b9db, 8fb50c17bb27da3d117b029e4948fcca, 9f98d24cb38e778755e7bb1a46a77261 2023-03-11 00:56:27,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/.tmp/info/1d1a0a4235714ee1991ef756a1830780 2023-03-11 00:56:27,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d1a0a4235714ee1991ef756a1830780 2023-03-11 00:56:27,455 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-11 00:56:27,455 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-11 00:56:27,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261/.tmp/info/4364dacfc8494c859aec42d69117cdc9 2023-03-11 00:56:27,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261/.tmp/info/4364dacfc8494c859aec42d69117cdc9 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261/info/4364dacfc8494c859aec42d69117cdc9 2023-03-11 00:56:27,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261/info/4364dacfc8494c859aec42d69117cdc9, entries=3, sequenceid=7, filesize=4.8 K 2023-03-11 00:56:27,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 9f98d24cb38e778755e7bb1a46a77261 in 417ms, sequenceid=7, compaction requested=false 2023-03-11 00:56:27,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/namespace/9f98d24cb38e778755e7bb1a46a77261/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-11 00:56:27,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:56:27,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f98d24cb38e778755e7bb1a46a77261: 2023-03-11 00:56:27,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1678496018029.9f98d24cb38e778755e7bb1a46a77261. 2023-03-11 00:56:27,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 78c948ce5e0a1cdee67cd729e4b6b9db, disabling compactions & flushes 2023-03-11 00:56:27,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:56:27,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:56:27,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. after waiting 0 ms 2023-03-11 00:56:27,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:56:27,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testScannerOnBulkLoadRefHFiles/78c948ce5e0a1cdee67cd729e4b6b9db/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-11 00:56:27,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:56:27,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 78c948ce5e0a1cdee67cd729e4b6b9db: 2023-03-11 00:56:27,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1678496057623.78c948ce5e0a1cdee67cd729e4b6b9db. 2023-03-11 00:56:27,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8fb50c17bb27da3d117b029e4948fcca, disabling compactions & flushes 2023-03-11 00:56:27,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:27,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:27,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. after waiting 0 ms 2023-03-11 00:56:27,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:27,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/8fb50c17bb27da3d117b029e4948fcca/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 00:56:27,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:27,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8fb50c17bb27da3d117b029e4948fcca: 2023-03-11 00:56:27,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1678496168872.8fb50c17bb27da3d117b029e4948fcca. 2023-03-11 00:56:27,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 36cfe1c0fa36465e8e4065cb6f4feb3e, disabling compactions & flushes 2023-03-11 00:56:27,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:56:27,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:56:27,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. after waiting 0 ms 2023-03-11 00:56:27,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:56:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/36cfe1c0fa36465e8e4065cb6f4feb3e/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-11 00:56:27,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:56:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 36cfe1c0fa36465e8e4065cb6f4feb3e: 2023-03-11 00:56:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678496019278.36cfe1c0fa36465e8e4065cb6f4feb3e. 2023-03-11 00:56:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2dd70ffc836295255740f79f024e3511, disabling compactions & flushes 2023-03-11 00:56:27,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:56:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:56:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. after waiting 0 ms 2023-03-11 00:56:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:56:27,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMinorCompactionWithWeeklyPolicy/2dd70ffc836295255740f79f024e3511/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-11 00:56:27,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:56:27,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2dd70ffc836295255740f79f024e3511: 2023-03-11 00:56:27,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1678496046617.2dd70ffc836295255740f79f024e3511. 2023-03-11 00:56:27,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 327735cd40a8e23c9c8cdf4047ec37a3, disabling compactions & flushes 2023-03-11 00:56:27,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:56:27,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:56:27,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. after waiting 0 ms 2023-03-11 00:56:27,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:56:27,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionWithWeeklyPolicy/327735cd40a8e23c9c8cdf4047ec37a3/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-11 00:56:27,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:56:27,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 327735cd40a8e23c9c8cdf4047ec37a3: 2023-03-11 00:56:27,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1678496062646.327735cd40a8e23c9c8cdf4047ec37a3. 2023-03-11 00:56:27,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 053e1f32f2dd2afeb0e5696a70cb7982, disabling compactions & flushes 2023-03-11 00:56:27,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:56:27,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:56:27,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. after waiting 0 ms 2023-03-11 00:56:27,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:56:27,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/053e1f32f2dd2afeb0e5696a70cb7982/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-11 00:56:27,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:56:27,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 053e1f32f2dd2afeb0e5696a70cb7982: 2023-03-11 00:56:27,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1678496113141.053e1f32f2dd2afeb0e5696a70cb7982. 2023-03-11 00:56:27,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3117f002e6ad4ea015cd6759edd92f71, disabling compactions & flushes 2023-03-11 00:56:27,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:27,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:27,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. after waiting 0 ms 2023-03-11 00:56:27,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:27,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testMajorCompactionFromAdmin/3117f002e6ad4ea015cd6759edd92f71/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 00:56:27,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:27,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3117f002e6ad4ea015cd6759edd92f71: 2023-03-11 00:56:27,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1678496168872.3117f002e6ad4ea015cd6759edd92f71. 2023-03-11 00:56:27,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f70d0cb8cdfe50a22b0232bd3d5c5b9, disabling compactions & flushes 2023-03-11 00:56:27,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:56:27,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:56:27,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. after waiting 0 ms 2023-03-11 00:56:27,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:56:27,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/default/testCompactionWithHFileLink/6f70d0cb8cdfe50a22b0232bd3d5c5b9/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-11 00:56:27,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:56:27,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f70d0cb8cdfe50a22b0232bd3d5c5b9: 2023-03-11 00:56:27,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1678496113141.6f70d0cb8cdfe50a22b0232bd3d5c5b9. 2023-03-11 00:56:27,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e8871741be4163356575157eead69a3, disabling compactions & flushes 2023-03-11 00:56:27,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:56:27,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:56:27,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. after waiting 0 ms 2023-03-11 00:56:27,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:56:27,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/ns/testMinorCompaction/1e8871741be4163356575157eead69a3/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 00:56:27,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:56:27,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e8871741be4163356575157eead69a3: 2023-03-11 00:56:27,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1678496139004.1e8871741be4163356575157eead69a3. 2023-03-11 00:56:27,632 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-11 00:56:27,833 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-11 00:56:27,854 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/.tmp/rep_barrier/3268c87bfedc4d33a11a7985444eefda 2023-03-11 00:56:27,858 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3268c87bfedc4d33a11a7985444eefda 2023-03-11 00:56:28,033 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-03-11 00:56:28,033 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-03-11 00:56:28,033 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-11 00:56:28,233 DEBUG [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-11 00:56:28,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/.tmp/table/b1dce3c40a034459a25a29de1f98e87b 2023-03-11 00:56:28,268 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1dce3c40a034459a25a29de1f98e87b 2023-03-11 00:56:28,269 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/.tmp/info/1d1a0a4235714ee1991ef756a1830780 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/info/1d1a0a4235714ee1991ef756a1830780 2023-03-11 00:56:28,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d1a0a4235714ee1991ef756a1830780 2023-03-11 00:56:28,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/info/1d1a0a4235714ee1991ef756a1830780, entries=226, sequenceid=130, filesize=37.9 K 2023-03-11 00:56:28,274 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/.tmp/rep_barrier/3268c87bfedc4d33a11a7985444eefda as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/rep_barrier/3268c87bfedc4d33a11a7985444eefda 2023-03-11 00:56:28,278 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3268c87bfedc4d33a11a7985444eefda 2023-03-11 00:56:28,278 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/rep_barrier/3268c87bfedc4d33a11a7985444eefda, entries=1, sequenceid=130, filesize=5.0 K 2023-03-11 00:56:28,278 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/.tmp/table/b1dce3c40a034459a25a29de1f98e87b as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/table/b1dce3c40a034459a25a29de1f98e87b 2023-03-11 00:56:28,282 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1dce3c40a034459a25a29de1f98e87b 2023-03-11 00:56:28,282 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/table/b1dce3c40a034459a25a29de1f98e87b, entries=27, sequenceid=130, filesize=6.6 K 2023-03-11 00:56:28,284 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1253ms, sequenceid=130, compaction requested=false 2023-03-11 00:56:28,291 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-11 00:56:28,291 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-11 00:56:28,291 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-11 00:56:28,292 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-11 00:56:28,292 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-11 00:56:28,433 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38819,1678496016129; all regions closed. 2023-03-11 00:56:28,440 DEBUG [RS:0;jenkins-hbase4:38819] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/oldWALs 2023-03-11 00:56:28,441 INFO [RS:0;jenkins-hbase4:38819] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38819%2C1678496016129.meta:.meta(num 1678496017744) 2023-03-11 00:56:28,445 DEBUG [RS:0;jenkins-hbase4:38819] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/oldWALs 2023-03-11 00:56:28,445 INFO [RS:0;jenkins-hbase4:38819] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38819%2C1678496016129:(num 1678496017599) 2023-03-11 00:56:28,445 DEBUG [RS:0;jenkins-hbase4:38819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:56:28,445 INFO [RS:0;jenkins-hbase4:38819] regionserver.LeaseManager(133): Closed leases 2023-03-11 00:56:28,445 INFO [RS:0;jenkins-hbase4:38819] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-11 00:56:28,446 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-11 00:56:28,447 INFO [RS:0;jenkins-hbase4:38819] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38819 2023-03-11 00:56:28,454 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38819,1678496016129 2023-03-11 00:56:28,454 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-11 00:56:28,454 ERROR [Listener at localhost/45619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d834e8e rejected from java.util.concurrent.ThreadPoolExecutor@49bcd3e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 00:56:28,455 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-11 00:56:28,455 ERROR [Listener at localhost/45619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a58ddbc rejected from java.util.concurrent.ThreadPoolExecutor@49bcd3e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 00:56:28,455 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38819,1678496016129] 2023-03-11 00:56:28,456 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38819,1678496016129; numProcessing=1 2023-03-11 00:56:28,457 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38819,1678496016129 already deleted, retry=false 2023-03-11 00:56:28,457 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38819,1678496016129 expired; onlineServers=0 2023-03-11 00:56:28,457 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40615,1678496014902' ***** 2023-03-11 00:56:28,457 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-11 00:56:28,458 DEBUG [M:0;jenkins-hbase4:40615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bcd4b4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-11 00:56:28,458 INFO [M:0;jenkins-hbase4:40615] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40615,1678496014902 2023-03-11 00:56:28,458 INFO [M:0;jenkins-hbase4:40615] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40615,1678496014902; all regions closed. 2023-03-11 00:56:28,458 DEBUG [M:0;jenkins-hbase4:40615] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 00:56:28,458 DEBUG [M:0;jenkins-hbase4:40615] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-11 00:56:28,458 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-11 00:56:28,458 DEBUG [M:0;jenkins-hbase4:40615] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-11 00:56:28,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1678496017254] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1678496017254,5,FailOnTimeoutGroup] 2023-03-11 00:56:28,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1678496017257] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1678496017257,5,FailOnTimeoutGroup] 2023-03-11 00:56:28,458 INFO [M:0;jenkins-hbase4:40615] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-11 00:56:28,458 INFO [M:0;jenkins-hbase4:40615] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-11 00:56:28,459 INFO [M:0;jenkins-hbase4:40615] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-03-11 00:56:28,459 DEBUG [M:0;jenkins-hbase4:40615] master.HMaster(1512): Stopping service threads 2023-03-11 00:56:28,459 INFO [M:0;jenkins-hbase4:40615] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-11 00:56:28,459 ERROR [M:0;jenkins-hbase4:40615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-11 00:56:28,460 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-11 00:56:28,460 INFO [M:0;jenkins-hbase4:40615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-11 00:56:28,460 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 00:56:28,460 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-11 00:56:28,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-11 00:56:28,460 DEBUG [M:0;jenkins-hbase4:40615] zookeeper.ZKUtil(398): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-11 00:56:28,460 WARN [M:0;jenkins-hbase4:40615] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-11 00:56:28,460 INFO [M:0;jenkins-hbase4:40615] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-11 00:56:28,461 INFO [M:0;jenkins-hbase4:40615] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-11 00:56:28,461 DEBUG [M:0;jenkins-hbase4:40615] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-11 00:56:28,461 INFO [M:0;jenkins-hbase4:40615] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 00:56:28,461 DEBUG [M:0;jenkins-hbase4:40615] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 00:56:28,461 DEBUG [M:0;jenkins-hbase4:40615] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-11 00:56:28,461 DEBUG [M:0;jenkins-hbase4:40615] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 00:56:28,461 INFO [M:0;jenkins-hbase4:40615] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.56 KB heapSize=598.38 KB 2023-03-11 00:56:28,556 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-11 00:56:28,556 INFO [RS:0;jenkins-hbase4:38819] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38819,1678496016129; zookeeper connection closed. 2023-03-11 00:56:28,556 ERROR [Listener at localhost/45619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1274ceed rejected from java.util.concurrent.ThreadPoolExecutor@49bcd3e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 00:56:28,556 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): regionserver:38819-0x100d11088a50001, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-11 00:56:28,556 ERROR [Listener at localhost/45619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40083ee9 rejected from java.util.concurrent.ThreadPoolExecutor@49bcd3e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 00:56:28,556 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1631ae48] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1631ae48 2023-03-11 00:56:28,556 INFO [Listener at localhost/45619] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-11 00:56:28,868 INFO [M:0;jenkins-hbase4:40615] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.56 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/06af9253e5a849f58faa59bcdfd169a0 2023-03-11 00:56:28,872 INFO [M:0;jenkins-hbase4:40615] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06af9253e5a849f58faa59bcdfd169a0 2023-03-11 00:56:28,872 DEBUG [M:0;jenkins-hbase4:40615] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/06af9253e5a849f58faa59bcdfd169a0 as hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/06af9253e5a849f58faa59bcdfd169a0 2023-03-11 00:56:28,875 INFO [M:0;jenkins-hbase4:40615] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06af9253e5a849f58faa59bcdfd169a0 2023-03-11 00:56:28,875 INFO [M:0;jenkins-hbase4:40615] regionserver.HStore(1080): Added hdfs://localhost:41469/user/jenkins/test-data/346f92bf-ace3-78a7-9098-17dc453971b6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/06af9253e5a849f58faa59bcdfd169a0, entries=123, sequenceid=1006, filesize=33.3 K 2023-03-11 00:56:28,876 INFO [M:0;jenkins-hbase4:40615] regionserver.HRegion(2948): Finished flush of dataSize ~512.56 KB/524866, heapSize ~598.36 KB/612720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 415ms, sequenceid=1006, compaction requested=false 2023-03-11 00:56:28,876 INFO [M:0;jenkins-hbase4:40615] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 00:56:28,876 DEBUG [M:0;jenkins-hbase4:40615] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-11 00:56:28,878 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-11 00:56:28,878 INFO [M:0;jenkins-hbase4:40615] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-11 00:56:28,879 INFO [M:0;jenkins-hbase4:40615] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40615 2023-03-11 00:56:28,881 DEBUG [M:0;jenkins-hbase4:40615] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40615,1678496014902 already deleted, retry=false 2023-03-11 00:56:28,982 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-11 00:56:28,982 INFO [M:0;jenkins-hbase4:40615] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40615,1678496014902; zookeeper connection closed. 2023-03-11 00:56:28,982 ERROR [Listener at localhost/45619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c420a9 rejected from java.util.concurrent.ThreadPoolExecutor@36c7212e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 00:56:28,983 DEBUG [Listener at localhost/45619-EventThread] zookeeper.ZKWatcher(600): master:40615-0x100d11088a50000, quorum=127.0.0.1:62412, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-11 00:56:28,983 ERROR [Listener at localhost/45619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e77a10 rejected from java.util.concurrent.ThreadPoolExecutor@36c7212e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 00:56:28,984 WARN [Listener at localhost/45619] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-11 00:56:28,987 INFO [Listener at localhost/45619] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-11 00:56:29,093 WARN [BP-2122782862-172.31.14.131-1678496011552 heartbeating to localhost/127.0.0.1:41469] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-11 00:56:29,094 WARN [BP-2122782862-172.31.14.131-1678496011552 heartbeating to localhost/127.0.0.1:41469] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2122782862-172.31.14.131-1678496011552 (Datanode Uuid 79787fa5-aa69-41d2-ac7e-af271957f260) service to localhost/127.0.0.1:41469 2023-03-11 00:56:29,096 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/cluster_222610a7-004e-a65d-0f45-8973b54f643a/dfs/data/data1/current/BP-2122782862-172.31.14.131-1678496011552] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-11 00:56:29,096 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/219cdaef-152d-9901-8c32-3056eba45478/cluster_222610a7-004e-a65d-0f45-8973b54f643a/dfs/data/data2/current/BP-2122782862-172.31.14.131-1678496011552] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-11 00:56:29,123 INFO [Listener at localhost/45619] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-11 00:56:29,261 INFO [Listener at localhost/45619] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-11 00:56:29,358 INFO [Listener at localhost/45619] hbase.HBaseTestingUtility(1293): Minicluster is down